Submitted to the An^ials of Applied Probability 
arXiv: 1112.2940 



UTILITY MAXIMIZATION WITH ADDICTIVE CONSUMPTION HABIT 
FORMATION IN INCOMPLETE SEMIMARTINGALE MARKETS 

By Xiang Yu 

University of Texas at Austin 

This paper studies the problem of continuous time expected util- 
ity maximization of consumption together with addictive habit for- 
mation in general incomplete semimartingale markets. Introducing 
the set of auxiliary state processes and the modified dual space, we 
embed our original problem into an abstract time-separable utility 
maximization problem with a shadow random endowment on the 
product space {fl x [0, T] , O, P) . We establish existence and unique- 
ness of the optimal solution using convex duality by defining the 
■ primal value function as depending on two variables, i.e., the initial 

wealth and the initial standard of living. We also provide market 
independent sufficient conditions both on the stochastic discounting 
processes and on the utility function for the well-posedness of our 
original optimization problem. Under the same assumptions, we can 
carefully modify the classical proofs in the approach of convex duality 
Ch ' analysis when the auxiliary dual process is not necessarily integrable. 
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1. Introduction. During the past decades, the assumption of time separabihty of von 
Neumann-Morgenstern preferences on consumption plan has been chahenged due to its lack 
J> ■ of consistency with many observed empirical evidences. For instance, the celebrated mag- 

. nitude of the equity premium [Mehra and Prescott [23]) can not be reconciled with the 

, preference IE[Jg U (t, Ct)dt] when the instantaneous utility function U is only derived from 

CNj I the consumption rate. As an alternative modeling tool, linear addictive habit formation pref- 

■ erence has attracted a lot of attention and has been actively investigated in recent years. 

This new way to compare consumption streams is defined by IE[/q^ U{t,ct — Zt)dt], where 
U : [0, r] X (0, oo) M and the additional accumulative process Zt, called the habit forma- 
tion or the standard of living process, describes the consumption history impact. In particular, 
Z. = Z{-;c) is defined in the following way: 



X: 



dZt = {6tct - atZt)dt, 
Zq = z, 

where the discounting factors at and 6t are generally assumed to be nonnegative optional 
processes and the given real number 2 > is called the "initial habit" or the "initial standard 
of living". Moreover, the consumption habits are assumed to be addictive in the sense that 
we impose the constraint that q > Zt for all time t £ [0, T]. 

Compared to the utility from consumption itself, a small drop in consumption may cause 
a large fiuctuation in consumption net of the subsistence level due to the standard of living 
constraint and hence can possibly explain sizable excess returns on risky assets in equilibrium 
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models even for moderate values of the degree of risk aversion. Based on this, there is a vast 
literatm'e that recommends the habit formation preference as the new economic paradigm 
which can resolve the equity premium puzzle as well as many other empirical observations, 
we refer the readers to, for instance, Constantinides [4], Samuelson [28] and Campbell and 
Cochrane [3]. 

At the intuitive level, the other remarkable feature of the habit formation preference is its 
reflection of consumers' rationality from the psychological perspective. The concept of habit 
formation characterizes the non-negligible effect of past consumption patterns on current 
and future economic decisions. Consumption behaviors in daily life often are repetitive and 
performed in customary places, leading consumers to develop habits. And high consumption 
history will generically lift up the investor's desired consumption plan for the future. On the 
other hand, an increase in consumption today increases his current utility but will depress 
all future utilities through the induced growth in future standards of living. 

The study of habit formation in modern economics dates back to Hicks [13] in 1965 and Ry- 
der and Heal [27] in 1973. More recently, in complete Ito processes markets, Detemple and Za- 
patero [10], [11] employed martingale methods to study the general nonlinear habit formation 
utility optimization problem IE[Jq U{t, ct, Zt)dt] and established some recursive stochastic dif- 
ferential equations for the consumption rate process q. Later, Schroder and Skiadas [30] made 
an insightful observation that to solve the optimal portfolio selection with utilities incorporat- 
ing linear addictive habit formation IE[/q^ U{t,ct — Zt)dt] in the complete market is equivalent 

to solving the time separable utility maximization IE[/q^ U {t, c[)dt] in the isomorphic complete 
market without habit formation. They also gave the construction of the isomorphic market 
based on the original market under some appropriate assumptions. Munk [24] applied the 
Market Isomorphism result in the complete market model with mean reverting drift process 
and stochastic interests rates process, and provides closed form optimal strategies in several 
special cases. Detemple and Karatzas [9] further considered the linear non-addictive habits 
E[Jq U (i, Ct — Zt)dt], where instead they define U : [0, oo) x (— oo, oo) — )• M. Their consump- 
tion Ct is required to be non- negative but is allowed to fall below the "the standard of living" 
index Zt that aggregates past consumption. They provided a constructive proof for the ex- 
istence of an optimal consumption plan, however, the market completeness is still a key 
assumption for their analysis. Englezos and Karatzas [12] exploited stochastic partial differ- 
ential equations and the first order condition in the non-Mar kovian complete market, and 
obtained stochastic feedback formulae for the optimal portfolio and consumption policies. 

Although significant progress has been made in the complete market setting, in the words 
by Englezos and Karatzas [12], "The existence of an optimal portfolio/consumption pair in an 
incomplete market is an open question. . . ., and new methodologies are needed to handle the 
problem." Therefore, in this paper, we are interested in the general incomplete semimartin- 
gale framework and aim to prove the existence and uniqueness of the optimal solution of this 
path dependent optimization problem by using convex duality analysis. To the best of our 
knowledge, our work is the first one which aims to solve the continuous time expected util- 
ity maximization problem with consumption habit formation in general incomplete financial 
markets. However, we also refer the readers to the very recent work by Muraviev [25], which 
treats the additive habit formation and random endowment in the discrete time incomplete 
markets using a very different analysis. 

The convex duality approach plays an important role in the treatment of general utility 
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maximization problems in the framework of incomplete markets. To list a very small subset of 
the existing literature in optimal investment and consumption problems, we refer to Karatzas, 
Lehoczky, Shreve, and Xu [16], Kramkov and Schachermayer [20], [21], Cvitanic, Schacher- 
mayer and Wang [5], Karatzas and Zitkovic [17], Hugonnier and Kramkov [15], Zitkovic [31], 
[32], Kauppila [18] and Larsen and Zitkovic [22]. 

Typically, the critical step to build conjugate duality results for utility maximization prob- 
lems is to define the dual space as the proper extension of space A4, the set of density 
processes of equivalent local martingale measures. Due to the presence of the habit formation 
process, the choice of the dual space and the formulation of the associated dual problem will 
become more elegant. By working in the product space L° (0 X [0,T],C',P), the first natural 
choice is the bipolar set of the space A4, which is the smallest convex, closed and solid set 
containing space A4. Kramkov and Schachermayer [20], [21], or, more precisely in the filtered 
version by Zitkovic [31], proved that this bipolar set can be characterized as the solid hull of 
the set y{y), which is defined as the set of supermartingales deflators 

Yq = y and XY = {XtYt)o<t<T is a supermartingale 
for each X G Af(x)|, 



y{y) = \Y>0 



where X{x) denotes the set of accumulated gains/losses process under some admissible in- 
vestment strategies with initial endowment less than or equal to x. However, according to 
the definition of the habit formation process Zt, the dual functional is no longer necessarily 
lower semicontinuous with respect to process Yt G y{y)- As a matter of fact, if we formally 
derive the naive dual problem by using the Legendre-Fenchel transform and the first order 
condition, we arrive at 



inf E 

y>o,Yey{y) 



V Yt + 6tE 



i: 



dt 



zE 



for which 



The first mathematical difficulty is the extra integral E /g^e-^o^'^" "'^'''^^yYtdt 

y{y) is not the appropriate dual space to show the existence of the optimal solution for the 
above optimization problem. However, it can still remind us to invoke the general treatment 
of random endowment developed by Cvitanic, Schachermayer and Wang [5], Karatzas and 
Zitkovic [17] and Zitkovic [32]. Their work requires another extension of the set which is 
now considered as the set of equivalent local martingale measures, to the set T> of bounded 
finitely additive measures. Nevertheless, their approach is inadequate to deal with the first 



yYsds 



m 



term of the dual problem, when the conditional integral part E 
the conjugate function V is taken into account. The analysis becomes more complicated since 
the conditional expectation is not well defined under finitely additive measures and the primal 
optimizer will possibly depends on the singular part of some finitely additive measures. 

In order to avoid the complexity of the path-dependence and difficulties stated above, we 
propose the novel transformation from the consumption rate process cj to its auxiliary process 
c = Q — Zj, so that the primal utility maximization problem becomes time separable with 
respect to the process q. This substitution idea from q to cj appeared firstly in the Market 
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Isomorphism result for complete markets by Schroder and Skiadas [30]. And meanwhile, for 
each equivalent local martingale measure density process y € A^, we define the auxiliary 
dual process Tt exactly by 

rT 



Yt + 6tE 



yt £ [o,T]. 



We naturally intend to rewrite the dual problem given above in terms of auxiliary process Tt 
instead of Yt so that the path dependence of Yj can be also hidden in the definition of process 



However, the integral E 



Jo e 



remains in the formulation of the dual prob- 
: exp{f^{—ai,)dv), which itself is fully deter- 



lem. By introducing the stochastic process Wt 
mined by the discounting processes 6t and at , one can shift the integral E 

r-T 



involving process Yt G M to the integral E 



with respect to its auxiliary process 



/p wtTtdt 

Tt- With the aid of this equality, we can naturally treat the extra exogenous random term 
lit as some shadow random endowment density process in the abstract product space, and 
define the dual functional on the properly modified space of Tt instead of Yt. Now, as long 
as the initial standard of living value z is regarded as the variable of the value function, we 
can add one more dimension to the conjugate duality results and hide the extra integral term 
E WtTtdt by controlling its values. In essence, by enlarging the effective domain of values 
for X and z, we arrange to embed our original utility maximization problem with consump- 
tion habit formation into the framework of Hugonnier and Kramkov [15] for an abstract time 
separable utility maximization on the product space. 

On the other hand, we are facing issues in trying to apply the classical convex duality re- 
sults when the auxiliary dual space may not be a subset of L,^{Q x [0, T], O, P). Therefore, we 
impose the additional market independent sufficient conditions on habit formation discount- 
ing factors at and 6t, see Assumption (3.3) and (3.4), to guarantee the well-posedness of the 
Primal optimization problem. We also ask for Reasonable Asymptotic Elasticity conditions 
on utility functions U both at x — > and x — >• oo, i.e., AEq[U] < oo and AEao[U] < 1 (see 
Assumption (2.9) and (2.10)), for the validity of several key assertions of our main results to 
hold true. 



The rest of this paper is organized in the following way: Section 2 first describes the 
financial market. For the purpose to ensure the original utility optimization problem is well 
defined and to assist future proofs of the main results, we impose the Reasonable Asymptotic 
Elasticity Condition of the Utility function both for x = oo and x = 0. In Section 3, we intro- 
duce some functional set-up on the product space L^(r2 x [0, T], O, P), and define the auxiliary 
process domain A{x, z) and the auxiliary dual space M. We embed our original problem into 
an abstract time separable utility maximization problem over the enlarged abstract admis- 
sible space A(x, z), however, with the shadow random endowment. We first assume that the 
extra exogenous term £ = e-^o^^^~°'^^'^'^'dt is not replicable under the original market in 
Section 4, and this section is devoted to the definition of the two dimensional dual problem 
over the properly enlarged dual space y{y, r) for the auxiliary primal optimization problem 
and our main results are stated in the end. Section 5 contains the proofs of our main results. 
Section 6 complements our main results by concerning the special case of replicable extra 
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exogenous term £. Some important and interesting features of the abstract dual space are 
discussed and one explicit example is presented at the end by assuming that the discounting 
factors are deterministic functions. 



2. Market Model. 

2.1. The Financial Market Model. We consider a financial market with d S N risky assets 
modeled by a d-dimensional semimartingale 

(2.1) S = {S\'\...,S[\^^,^T] 

on a given filtered probability space J", F = {Tt)Q<t<T-,^)-, where the filtration F satisfies 
the usual conditions and the maturity time is given by T. To simplify our notation, we take 

We make the standard assumption that there exists one riskless bond sf^ = l,Vt G [0,T], 
which amounts to consider sf^ as the numeraire asset. 

The portfolio process H = . . . , i/j'^^)^g[o,T] is a predictable S'-integrable process 

representing the number of shares of each risky asset held by the investor at time t G [0, T]. 
The accumulated gains /losses process of the investor under his trading strategy H by time t 
is given by: 

(2.2) Xf = {H.S)t = Y, f H^'^dS'^^^ t e [0' 



2.2. Admissible Portfolios and Consumption Habit Formation. The portfolio process {Ht)te[o,T] 
is called admissible if the gains/losses process X^^ is bounded below, which is to say, there 
exists a constant bound a € M such that X/^ > a, a.s. for all t G [0,T]. 

Now, given the initial wealth x > 0, the agent will also choose an intermediate consumption 
plan during the whole investment horizon, and we denote the consumption rate process by 
ct. The resulting self- financing wealth process (VFj^'^''^)t£[o,T] is given by 

(2.3) Wt'^'" = x+{H-S)t - [ Csds, t G [0,T]. 

Jo 

Besides of the wealth process, as we already defined in the Introduction, the associated 
consumption habit formation or the standard of living process Z. = Z{-;c) is given equiva- 
lently by the following exponentially weighted average of agent's past consumption integral 
and the initial habit 

(2.4) Zt = ze-^o"-'^^ + / 6se-^^"-'^"csds, 

Jo 

where discounting factors at and 5t measure, respectively, the persistence of the initial habits 
level and the intensity of consumption history. In this paper, we shall be mostly interested 
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in the general case when the discounting factors at and 6t are stochastic processes which 
are ahowed to be unbounded. The stochastic nature of the discounting factors corresponds 
to various market features. For instance, the investor may randomly change his weights on 
the consumption habits impact due to his risk preference change, time- varying impatience or 
other time inconsistent factors from the financial market. 

Throughout this paper, we make the assumption that the consumption habit is addictive, 
i.e., Cf > Zt, Vt € [0, T], which is to say, the investor's current consumption rate shall never 
fall below "the standard of living" process. 

A consumption process ict)te[o,T] is defined to be (x, 2:)-financeable if there exists an ad- 
missible portfolio process (-fft)jg[o,T] such that W^'^'"^ > 0, Vt € [0,r], a.s. and the addictive 
habit formation constraint q > Zt, Vi € [0,T] a.s. holds. The class of all (x, z)-financeable 
consumption rate processes will be denoted by A{x,z), for x > 0, z > 0. 



2.3. Absence of Arbitrage. A probability measure Q is called an equivalent local mar- 
tingale measure if it is equivalent to P and if Xf^ is a local martingale under Q. We denote 
by A4 the family of equivalent local martingale measures and in order to rule out the arbitrage 
opportunities in the market, we assume that 

(2.5) 7W / 0. 

We refer the readers to Delbaen and Schachermayer [6] and [7] for a comprehensive discussion 
and treatment on the topic of no arbitrage. 
Define the RCLL process by 



dl 



Tt 



for the Q G 7W , then y is called an equivalent local martingale measure density and we shall 
always identify the equivalent local martingale measure Q with its density process y*^, and 
with a slight abuse of notation, we denote 7W also as the set of all equivalent local martingale 
density processes. 

The celebrated Optional Decomposition Theorem, see Kramkov [19], enables us to char- 
acterize the (x, z)-financeble consumption process in terms of linear inequalities with respect 
to 1^ € Ai, called Budget Constraint, and this serves as an important ingredient in the 
treatment of our utility maximization problem via convex duality approach. 

Proposition 2.1. The process {ct)t£[o^T] ^-^ financeable if and only if ct > Zt, Vt G 

[0, T] and 



(2.6) e[ / 



ctYtdt 



< X, yVt G M. 



Remark 2.1. It is easy to see the set of (x, 2;)-financeble consumption processes is in 
general not solid. This means it is not allowed to consume as less as we want since the habit 
formation constraint may not be retained. Some technical questions in convex duality arise 
as we expect the solid hull of the financeble set is now generically complicated to describe. 
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2.4. The Utility Function. The individual investor's preference is represented by a utility 
function U : [0, T] x (0, oo) M, such that, for every x > 0, U{-,x) is continuous on [0, T], and 
for every t G [0,r], the function U{t,-) is strictly concave, strictly increasing, continuously 
differentiable and satisfies the Inada conditions: 

(2.7) U'{t, 0) = lim U'{t, x) = oo, U'{t, oo) = lim U'{t, x) = 0. 

a;— >0 x—i-oo 

where U'{t, x) = -^U {t, x). For each t G [0, T], we extend the definition of the utility function 
by U{t, x) = —oo for all x < 0, which is equivalent to the addictive habit formation constraint 
ct > Zt when the utility function is defined on the difference between the consumption rate 
process q and habit formation process Z^. 

According to these assumptions, the inverse I{t, •) : IR+ of the function U'{t, •) exists 

for every t € [0, T], and is continuous and strictly decreasing with: 

(2.8) I(t, 0) = \iml(t, x) = oo, I(t, oo) = lim I(t, x) = 0. 

x— >0 x— i-oo 

The convex conjugate of the agents' utility function, also known as the Legendre-Fenchel 
transform, is defined as follows: 

V{t,y) = sup{U{t,x) - xy}, y > 0. 

Under the Inada conditions (2.7), the conjugate of V{t, •) is a continuously differentiable, 
strictly decreasing and strictly convex function satisfying V'{t,0) = — oo, V'{t,oo) = and 
V(t,0) = f/(t, oo), V{t,oo) = U{t,0), see, for example, Karatzas, Lehoczky, Shreve, and Xu 
[16] for reference. 

Follow the asymptotic growth control of the utility functions coined by Kramkov and 
Schachermayer [20], see also Karatzas and Zitkovic [17], we shall make additional assumptions 
on the asymptotic behavior of U at both x = and x = oo for future purposes: 

Assumption 2.1. 

The utility functions U satisfies the Reasonable Asymptotic Elasticity condition both at x = oo 
and x = 0, i.e., 



(2.9) AE^[U] = hmsupf sup ^^[^) < 1, 

x-^oo ^te[0,T] U{t,x) J 

and 

(2.10) A£;o[?7] = limsupf sup ^.^/^'^i ) < oo. 
Moreover, in order to get some inequalities uniformly in time t, we shall assume 



(2.11) lim inf U(t,x)] > 0, 

x^oo\telO,T] J 

and 

(2.12) lim ( sup V[t,x) \ < 0. 
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Remark 2.2. Many well known utility functions satisfy Reasonable Asymptotic Elasticity 
Assumptions (2.9) and (2.10), for example, the discounted log utility function U{t,x) = 
e~^*log{x) or discounted power utility function U{t,x) = e~^*^ {p < 1 and p ^ 0), for a 

constant /3 > 0. However, it is also easy to check that the utility function \J (t, x) = —e~ does 
not satisfy the Assumption (2.10) and the utility function U {t, x) = does not satisfy the 
Assumption (2.9). 

Remark 2.3. If the utility function satisfies the lower bound assumption inf U {t, 0) > 

— oo, then our Assumption (2.10) is automatically verified. And if the utility function satisfies 

the upper bound assumption sup U (t, oo) < oo, the Assumption (2.9) holds true. 

ie[o,T] 

Remark 2.4. The utility function U {t, x) satisfies Reasonable Asymptotic Elasticity As- 
sumptions (2.9) and (2.10) if and only if its affine transform a + bU{t,x) satisfies Reasonable 
Asymptotic Elasticity Assumptions (2.9) and (2.10) for arbitrary constants a,b > 0. Hence, 
the adjoint Assumption (2.11) and Assumption (2.12) are not restrictive. 

The next technical result gives the equivalent characterization of the Reasonable Asymp- 
totic Elasticity condition AEoo[U], which follows the identical proof of Lemma 6.3 of Kramkov 
and Schachermayer [20], see also Proposition 3.7 of Karatzas and Zitkovic [17]. 

Lemma 2.1. Let U{t,x) be a utility function satisfying (2.9) and (2.11). In each of the 
subsequent assertions, the infimum of ^ > for which these assertions hold true equals the 
Reasonable Asymptotic Elasticity AEao[U]. 

(i) There is xq > for all t £ [0, T] s.t. 

U{t, Xx) < U{t,x) for\>l,x>xo. 
(a) There is xq > for all t £ [0,T] s.t. 

f/'(t,x) <7-^^^^ forx>xo. 

X 

(Hi) There is yo > for all t G [0, T] s.t. 

V{t, /xy) < /i"^ V{t, y) forO< n<l,0<y <yo. 
(iv) There is yo > for all t € [0, T] s.t. 

-V'{t,y)<(-^)^^ forO<y<yo. 
Kl-'jJ y 

Corollary 2.1. Under Assumptions (2.10) and (2.12), we have AEq[U] < oo if and 
only if AEcx:y[V] < 1, where we define 

(2.13) AEoo[V] =limsup( sup ^^r^) < 1' 



^te[o,T] V{t,y) 



and hence similarly, we have each of the following assertions, the infimum o/ 7 > for which 
these assertions hold true equals the Reasonable Asymptotic Elasticity AEca[V]. 
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(i) There is i/q > for all t G [0, T] s.t. 

V{t,Xy)> X^V{t,y) forX>l,y>yo. 

(ii) There is yo > for all t € [0, T] s.t. 

V'{t,y)>^^^^^ fory>yo. 

y 

(Hi) There is xq > for all t G [0,T] s.t. 

U{t, ^x) > U{t, x) for < fi < 1,0 < X < Xq. 

(iv) There is xq > for all t £ [0,T] s.t. 

- U'{t, x) > (-^) -^^^ forO<x< xo. 



1 — 7/ X 



3. A New Characterization of Financeable Consumption Processes. 

3.1. Some Functional Set Up. In the spirit of Bouchard and Pham [1] which treated 
the wealth dependent problem (see also Zitkovic [32] on consumption and endowment with 
stochastic clock), let O denotes the u-algebra of optional sets relative to the filtration {J~t)te[o,T] 
and we define the product measure dF = dt x dF he the finite measure on the product space 
{nx[0,T],O) : 



(3.1) 



[A] = ¥F 



T 



l^(t, uj)dt 



for AeO. 



We denote by L*^(il x [0, T], (!?, IP) (L*^ for short) the set of all random variables on the 
product space Q x [0, T] under the product measure P with respect to the optional cr-algebra 
O endowed with the topology of convergence in measure P. And from now on, we shall 
always identify the optional stochastic process (5^)tg[o,T] with the random variable Y € 
X [0,r],C',P). We also define the positive orthant'L^ (O x [0,T],O,f) (L^ for short) 
the set of elements Y = Y{t,uj) of such that: 

y > 0, P U.S.. 

For any Y^,Y^ € L*^, we shall say that 

Y^ = if Y^ = P a.s.. 

Endow L*]^ with the bilinear form valued in [0, 00] as: 

rT 



X,Y) 



E 



XfYdt 







for ah A,y G L° . 



We also define a partial ordering on for convenience: 

yi < (^)y2 yi < (<)y2, 



a.s.. 
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3.2. Path- dependence Reduction by Auxiliary Processes. At this point, we are able to 
define the set of all (x, 2;)-financeable consumption rate processes as a set of random variables 
on the product space (fi x [0,T],O,IP) and the Budget Constraint Proposition 2.1 states 
that: 



A{x, z) = |c G L° : Q > Zt and Wt = x+ 

{H ■ S)t- Csds > 0, Vt G [0,T] and H is admissible} 

= {c G L° : Q > Zt, Vt G [0,r] and {c,Y) < x, G >[}. 

where process Zt is defined by (2.4). However, the family A{x,z) may be empty for some 
values X > 0, z > 0. We shall restrict ourselves to the effective domain H which is defined 
as the union of the interior of set such that A{x, z) is not empty and the one side boundary 
{x > 0,z = 0}: 



(3.2) 



n = mt|(x, z) G (0, oo) X [0, oo) : A{x, z) / 0| U (0, oo) x {0}. 



We want the effective domain i-L to include the special case of zero initial habit by z = 0. 

Before we state the next result, we shall first impose some additional conditions on the 
stochastic discounting factors at and 5t, which are essential for the well-posedness of our 
primal utility optimization problem : 

Assumption 3.1. 
We assume the nonnegative optional processes at and 6t satisfy: 



(3.3) 



sup E 







< oo. 



and there exists a constant x > such that 



(3.4) 



E 



U{t,xe--l'o°'-'^'')dt 







> —oo. 



Remark 3.1. If stochastic discounting processes at and 6t are assumed to be bounded. 
Assumptions (3.3) and (3.4) will be satisfied, and are redundant. Assumption (3.3) is the 
well known super-hedging property of the random variable e-^o^^'"~"''"^^'"dt in our original 
financial market. We make Assumption (3.4) here to guarantee the existence of some (x, z) G 
"H such that the value function u(x,z) > —oo. It is interesting to note that the process 
Wt = e~-'o°'^ somehow plays the same role as the constant 1 to be a universal strictly 
positive element in the corresponding admissible space by rescaling. And we remark here 
that one can also take the abstract numerare. 



Lemma 3.1. Under Assumption (3.3), the effective domain % can he rewritten explicitly 



as: 



(3.5) 



7^ = |(x, z) G (0, oo) x [0, oo) : X > z sup eT / e^o^^''-"^^'^''Ytdt\ ] 
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Proof. It is enough to show for all (x, z) G (0, oo) x [0, oo) 



(3.6) 



X > z sup E 



Jo{Sv-ay)dvY 







if and only if A{x, z) 7^ 0. 

On one hand, if {x, z) S (0, 00) x [0, 00) and A{x, z) ^ 0, by definition, there exists c E L'], 
such that Ct > Zt for all t G [0,T] and (c, y) < x,\/Y € M. We now claim that we should 
always have q > q for all t G [0, T] where q = Z{c)t is the subsistent consumption plan 
which equals its standard of living process. To this end, we first recall by the definition of Zt 
that dZt = {5tCt — atZt)dt with Zq = z > 0, and the constraint that q > Zt implies 

(3.7) dZt > {6tZt - atZt)dt, Zq = z, 
also, we should have cj satisfies 

(3.8) dct = {5tct - atct)dt, cq = z. 

and we can solve ct = ze-^oC^"-^^")'^^' for t G [0, T]. 

By the simple subtraction of (3.7) and (3.8), one can get 

d{Zt - Ct) > {St - at){Zt - ct)dt, Zq-cq = 0, 

from which we can derive that 

(3.9) Jo^^s-»s)ds^^^ _ - ^) > g JQ^2^]^ 

Hence, we will conclude that ct > ze^o'^^'^"^'^)'^'" for all t G [0, T], which gives 

j; > z sup E / e^o(^--°'-)'i''Ytdt 
YeM L Jo ^ 

by the consumption Budget Constraint condition (2.6). 

One the other hand, if (x, z) G (0, 00) x [0, 00) and (3.6) holds, we can obviously always 
construct q = ^e-Z'o such that q = Z{c)t for ah t G [0,r] and {c,Y) < x,Vy G M, 
and hence A{x, z) ^ 0. The proof is complete. □ 

By choosing (x, z) G we can now define the preliminary version of our Primal Utility 
Maximization Problem as: 



(3.10) 



u(x, z) = sup E 



T 



U{t,ct - Zt)dt , (x,z) G n. 



Now, for fixed {x,z) G H, and each (x, 2;)-financeable consumption rate process, we want 
to generalize the Market Isomorphism idea by Schroder and Skiadas [30] in order to reduce 
the path dependency. We are ready to introduce the auxiliary process ct = ct — Zt, and define 
the auxiliary set of A{x, z) as: 



(3.11) 



^(x,z) = |c G L°_ : Ct = Ct - Zt, yt e [0,T], cG^(x,z)|. 
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Lemma 3.2. For each fixed {x,z) G H, there is a one to one correspondence between sets 
A{x, z) and A{x, z), and hence we have A{x, z) 7^ for (x, z) Gli. 

Proof. Fix each pair (x, z) H so that A{x, z) 7^ 0, it is clear by the definition that for 
each c G A{x, z), there exists a unique ct = ct — Zt such that c G A{x, z). 
Now for each fixed (x, z) and c £ A, denote the process 

ct = ct + Zt, 

where the process Zt is uniquely determined by the process c as 

It is easy to check by definition that ct — Zt = ct > 0, where we know 

Zt = ze-^o^-d-^ + f 6se-^s»-d^csds. 
Jo 

Now by the definition of set A{x, z) and the uniqueness of process ct such that ct — Zt = ct, 
we can therefore conclude there exists a unique q G A{x, z) for each c G A{x, z). □ 

Let's turn our attention to the set M of equivalent local martingale measures, and for 
each y G A^, according to Assumption (3.3) we can define the auxiliary optional process 
with respect to as: 

(3.12) Tt = Yt + 6tE e^ti.S--'^-)d^Ysds Ft , VtG[0,T]. 
Let's denote the set of all these auxiliary optional processes as: 

(3.13) >i = |r gL° : Tj = yj + ,5jE ^ e^ti.^''-'^-)d^Y,ds Tt , VtG[0,T], Y M^. 

We remark again here that since stochastic discounting processes 5t and at are unbounded, 
under Assumption (3.3), the auxiliary dual process F is well defined, but it is not necessarily 
in L^. 

The following important equalities serve as critical ingredients in embedding our original 
utility maximization problem into an auxiliary abstract optimization problem on the product 
space, for which we are able to apply the convex duality approach: 

Proposition 3.1. Under Assumption (3.3), for each nonnegative optional process ct such 
that ct > Zt with Zt defined by (2.4) for fixed initial standard of living z > and the nonneg- 
ative optional process Yt, we have the following equalities with respect to their corresponding 
auxiliary processes ct = ct — Zt and Tt which is defined by (3.12), that: 

.3 14^ {c,Y) = {c,T) + z{w,Y) 

= {c,T) + z{w,T), 

where we define these extra exogenous random processes w, w £ lJ\_ as 

(3.15) A g/o*(<5„-a.)d« wt = e^oi-'^-)'^^ for all t e [0,T]. 
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Proof. By the definition, Zt solves the ODE: dZt = {5tCt — atZtjdt with Zq = z, for each 
t E [0, T]. If we set Ct = Ct — Z^, we can rewrite q in terms of q as: 



ct = ze 



/q (<5„-a„)di' 



+ Ct + 



and hence we will have the following chain equivalence by Pubini-Tonelli's theorem: 



c,Y) =zE 







+ E 









--z{w,Y) + ¥. 



T 



ctYtdt+ / 6sC, 



T 



T 



Jl{Sv~a,)dvY^dt]ds 



T 



ctYtdt+ / 6tCtE 



T 



T 



=z{w,Y) + E 
=z{w,Y) + {c,r), 
which gives the first equality. Similarly, we just observe that: 



i:iSv-a.)dvY(lg 



dt 



{w,T) =E 
=E 
=E 
=E 



Joi-^v)dvY^dt 

-Joi~^-)'^'"Ytdt 
Joi-»v)dvY^^ 



+ E 
+ E 
-E 
-E 



Ioi-c^v)dvg^-^l f j:(^--^-)d^Ysds 



dt 



f,^i5.-a.)dvY ( f S.e~IoS-'^^dt]ds 



l]ds 



Joi-^v)dvYdt 



+ E 



T 



joi^^-'^-y^Ytdt 



={w,Y), 
which gives the second equality. 



□ 



Remark 3.2. These extra random processes wt and wt in (3.15) defined by stochastic 
discounting factors at and 5t will play the role of shadow random endowment rate processes 
in the future formulation of the dual optimization problem. In an attempt to analyze this 
special structure, we will naturally adopt some classical convex duality analysis with respect 
to market random endowment source, and try to prove some similar results. 

Based on previous Propositions 2.1 and 3.1, under Assumptions (3.3) and (3.4), clearly we 
will have the alternative budget constraint characterization of the consumption rate process 
Ct as: 

Proposition 3.2. For any given pair {x,z) G li, we call the consumption rate process c 
is {x, z)-financeable if and only if ct > Zt, Vt € [0, T] and 



(c-Z,r) <x-z{w,T), for allT gM. 
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Proposition 3.2 provides us the alternative definition of set A{x, z) for (x, z) ^ T-L as: 



We see that the path-dependent addictive habits constraint on ct such that ct > Zt eventually 
turns to be a natural constraint that c G L^, and (3.16) states that the auxiliary set A{x, z) 
is solid, convex and closed in measure P although A{x, z) does not hold all these properties. 
Hence this path-dependence reduction from q to ct is crucial to enable us to work with convex 
duality approach. 

3.3. Embedding into an Abstract Utility Maximization Problem with the Shadow Random 
Endowment. In order to apply the classical convex duality analysis for the random endow- 
ment and build conjugate duality relations between value functions in the next section, due 
to some technical reasons, we need to first enlarge the domain of the set H to Ti and enlarge 
the corresponding auxiliary set A{x, z) to A{x, z) defined as: 



(3.16) 




(3.17) 




where now {x,z) G M^, and is restricted in the enlarged domain Ti: 




Under Assumption (3.3) and Proposition 3.1, we have the following equivalent characteri- 
zation of A{x, z): 



Lemma 3.3. 



(3.18) 




where 



(3.19) 




and 



(3.20) 




where p,p < (x> and % is a well defined convex cone in M'^. Moreover 



(3.21) 




where clT-L denotes the closure of the set Ti. in M^. 
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Proof. Again, it is just enough to show | (x, z) € : x > z(w,T')^ for all Vt € Al| is 
equivalent to z) G . ^(^^^ ^) _^ 

On one hand, if {x,z) € S ^ '■ A{x,z) 7^ 0|, there exists c € lJ\_ such that 

(c, r) < X — r) for all F G A4, clearly, we get x > z{w, F), for all F G M.. 

On the other hand, if {x,z) G G : x > z{w, F), for ah Ft G A^}, it is trivial 

to construct q = G ^(x, z) for all t G [0, T], therefore, we have {x,z) G G : 

^(x, z) 7^ 0|, which completes the proof. □ 

We will now define the Auxiliary Primal Utility Maximization Problem based on 
the abstract auxiliary domain A{x^ z) as: 

r /"^ 1 

(3.22) m(x,z)= sup E / U{t,ct)dt , {x,z) en. 

By definitions of A{x, z) for [x, z) G H and A{x, z) for (x, z) G %, we successfully embedded 
our original utility maximization problem (3.10) with consumption habit formation into the 
auxiliary abstract utility maximization problem (3.22) without habit formation, however, 
with some shadow random endowments. More precisely, the following equivalence can be 
guaranteed that for any (x, z) ^ V. C H: 

(3.23) A{x,z) = A{x,z), 
and the two value functions coincide 

(3.24) u{x, z) = u{x, z), 

in addition, the immediate byproduct consequence states that is the optimal solution for 
u{x,z) if and only if = — > for all t G [0, T] is the optimal solution for u{x,z), 
when (x, z) G H. 



4. The Dual Optimization Problem and Main Results. Inspired by the idea in 
Hugonnier and Kramkov [15] for optimal investment with random endowment, we concentrate 
now on the construction of the dual problem by first introducing the set IZ, which is the 
relative interior of the polar cone of —%: 

(4.1) n = h| (y, r) G : xy - zr > for ah (x, z) G . 

Let's make the following assumption on stochastic discounting processes at and 5t: 

Assumption 4.1. 
The random variable defined by 

(4.2) £^ rwtdt= /"'^e^o(^--"")'^Vt 

Jo Jo 

is not replicable under our original financial market. 
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Remark 4.1. Under our Assumption (4.2), the existence of Market Isomorphism by 
Schroder and Skiadas [30] may no longer hold and our work generally extends their conclusion 
and provides the existence and uniqueness of the optimal solution in incomplete markets using 
convex duality. 

Remark 4.2. We remark here that even if ^- = wtdt is replicable in the original 
incomplete market such that p = p, the market isomorphism relation by Schroder and Skiadas 
[30] may still not hold. In this case, however, the original utility maximization problem 
becomes easier since we do not need to take care of the exogenous term wt and the primal 
value function u becomes one dimensional function. The special case is discussed in detail in 
the final section 6. 

Lemma 4.1. By Assumption (4.2), we know that TZ is an open convex cone in M^, and 
can he rewritten as: 

(4.3) TZ = |(y,r) e : y > 0, and py < r < pyj, 
where p and p are defined by (3.19) and (3.20), and p < p. 

Proof. Since p < phy Assumption (4.2), and by Lemma 3.3 the set clV. = {{x, z) € : 
X > pz,z > 0} U {{x,z) £ M? : X > pz,z < 0} does not contain any lines passing through 
the origin. By the properties of polars of convex sets (See Rockafellar [26], Corollary 14.6.1), 
TZ is an open convex cone in the first orthant of M^. Moreover, by the inequality constraint 
xy — zr > for all (x, z) £% and the definition of it is obvious that (4.3) holds. □ 

For an arbitrary pair (y, r) G TZ, we denote by y{y, r) the set of nonnegative processes as 
a proper extension of the auxiliary set M in the way that: 

(4.4) S^(y,r) = |r G L° : (a, P) < xy - zr, for all 5 G ^(x, z), and (x, z) G ?{|. 

Based on previous efforts, we are ready to establish the Auxiliary Dual Utility Maxi- 
mization Problem to (3.22) defined as: 



(4.5) v{y,r)^ inf e[ / V{t,Tt)dt], (y,r) G7^. 



The following theorems constitute our main results. And we provide their proofs through 
a number of auxiliary results in the next section. 

Theorem 4.1. Assume conditions (2.5), (2.7), (3.3), (3.4), (4.2) hold true. Assume also 
that (2.11), (2.12) and (2.10) {i.e.,AEQ[U] < oo) together with 

(4.6) u(x,z) < oo for some (x,z) G Ti. 



we will have: 
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(i) The function u is {—00,00) -valued on T-L and v{y,r) is {—oo,oo]-valued on TZ. And 
for each {y,r) G TZ there exists a constant s = s{y,r) > such that v{sy,sr) < 00. 
Moreover, we have the conjugate duality of value functions u and v: 

u{x,z)= inf {v{y,r)-\-xy — zr}, {x,z)£7i, 

v{y,r) = sup {u{x, z) — xy + zr}, {y,r)G7l. 

(x,z)eH 

(a) The solution T*{y,r) to the optimization problem (4.5) exists and is unique (in the sense 
of = in for all {y,r) € TZ such that v{y,r) < 00. 

Theorem 4.2. We now assume in addition to conditions of Theorem 4.1 that Assumption 
(2.9) (i.e., AEoo[U] < 1) holds. Then in addition to assertions of Theorem 4.1, we also have: 

(i) The value function v{y,r) is {—00, 00) -valued on {y,r) G TZ and v is continuously 
differentiahle on C 

(a) The solution c*{x,z) to optimization problem (3.22) exists and is unique (in the sense 
of= in h'^) for any {x,z) £ H. And there exists a representation of the optimal solution 
such that c^(x,z) > 0, P-a.s. for all t G [0, T]. 

(Hi) The superdifferential of u maps % into TZ, i.e., 

(4.7) du{x,z)cn, {x,z)e'H. 

Moreover, if{y,r) G du{x,z), then there exists a representation of the optimal solution 
such that r|(y, r) > 0, ¥-a.s. for all t G [0,T] and c*{x,z) and T*{y,r) are related by: 

^^g^ T:{y,r)=U'it,cUx,z)) or q*(x, z) = /(t, ^(y, r)), 

{r*{y,r),c*ix,z)) = xy- zr. 

(iv) If we restrict the choice of initial wealth x and initial standard of living z such that 
{x,z) gTI C7i, the solution c^x^z) to our primal utility optimization problem (3.10) 
exists and is unique, moreover, 

c*(x, z) = q*(x, z) - Zl{x, z). 



5. Proofs of Main Results. 



5.1. The Proof of Theorem 4.1. The following Proposition will serve as the key step to 
build some future Bipolar relationships: 



Proposition 5.1. Assume all assumptions of Theorem 4.1 hold true. Then the families 
[A{x,z)] and [y{y,r)] have the following properties: 
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(i) For any {x,z) G 7i, the set A{x,z) contains a strictly positive random variable on the 
product space. A nonnegative random variable c belongs to A{x, z) if and only if 

(5.1) (c, r) < — zr for all {y, r) € 7^ and T € y{y, r). 

(a) For any {y,r) S TZ, the set y{y,r) contains a strictly positive random variable on the 
product space. A nonnegative random variable T belongs to y{y, r) if and only if 

(5.2) (c, r) < — zr for all (x, z) G T-L and c S A{x, z). 

In order to prove Proposition 5.1, for any p > 0, we denote by M.{p) the subset of M that 
consists of measure densities Y ^ M. such that (w, 1") = p. Then for any density process 
Y G A^(p), define the auxihary set as 

(5.3) M{p) 4 |r G L° : Ft = Ft + (5fE / e^'^^^'-'^^^'^^Ysds Ft , Vt G [0, T], y G >t(p)}. 

J t 

We have {^w, V) = (^w, Y) = p. 

Define V as the open interval V = {p,p), where p,p are defined in (3.19) and (3.20). We 
have the following result. 

Lemma 5.1. Assume that conditions of Proposition 5.1 hold true and let p > 0. Then the 
set A4{p) is not empty if and only if p V = {p,p), where p,p are defined in (3.19) and 
(3.20) . In particular, 

(5.4) (J Mip) = M. 

where the set M. is defined by (3.13). 

Proof. The proof reduces to verifying that V = V\ where we define 

= {p > : M{p) / 0}. 

Similar to the proof of Lemma 8 of Hugonnier and Kramkov [15], one direction inclusion 
that V CV' is obvious. 

For the inverse, let p G V, {x,z) G clTi, T G A4{p), and we first claim there exists a 
c G A(x, z) such that 

P[c ^ 0] > 0, 

so we get 

< (c, r) < X — zp. 

As (x,z) is an arbitrary element of clT-L, we have p £V. 

As for the above claim, according to Theorem 2.11 of Schachermayer [29], Assumption 
(4.2) guarantees that for all 1" G A^, we have 

p < {w,Y) < p, 



HABIT FORMATION 19 

which is 

p < {w,T) < p, 

for all the T € M. Then by the definition of dV. in Lemma 3.3, we observe that for any 
{x,z) G clTi, we will have 

X — z{w, r) > 0, 

for all the F S 7W, and the claim holds by the definition of A{x^ z). □ 

Lemma 5.2. Assume that conditions of Proposition 5.1 hold true and let p V = {p,p), 
we have then M.{p) C y(l,p). 

Proof. The conclusion can be directly derived in light of the definition of A{x,z) and 

5^(1,^). □ 

Lemma 5.3. Assume that conditions of Proposition 5.1 hold true. For any {x,z) G "H, a 
nonnegative random variable c belongs to A{x, z) if and only if 

(5.5) (|c, r)<x — zp for all p G V and T G A4{p). 

Proof. If c G A{x,z), the definition of A{x,z) and the fact M{p) C A4 guarantee the 
validity of (5.5). 

On the other hand, for any c G such that (5.5) holds true, we will have: 

sup (c + zu;, = sup sup (^c + zw,r^ 



= sup sup ((c, r) + zpj <x. 
pe^reAi(p) ^ 

The claim holds according to the definition of A{x,z). □ 
PROOF OF PROPOSITION 5.1. 

For the validity of assertion (i), consider {x,z) G H, there exists a A > such that 
(x — A, z) G H since H is an open set. 

Let c G A{x — X,z), we wih have for any T e M, and wt = e~ >- 0, 



(5.6) {c,T) <x- X- z{w,r). 

^ A„~, 

Liuii yo.o) aiiu nupoaiLion o.i, we ueuiit; fJt 

for all F G A^: 



By Assumption (3.3) and Proposition 3.1, we define pt = ^wt > for all t G [0,r], then 



(p, F> < (c + p, F> < X - A - z{w, F> + ^{w, F> 
< X — A — z(^w, F) + A < X — z(^w, F). 

Hence, we have shown the existence of a strictly positive element pt y € A{x, z) by the 
definition of ^(x, z). 
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If (5.1) holds for some c G L^. The density process T G ^A{p) belongs to y{l,p) for allp G "P 
by Lemma 5.2, and hence (5.5) holds. Lemma 5.3 then implies that c G ^(x, 2:). Conversely, 
suppose now c G A{x,z), the definition of sets y{y,r), {y,r) G TZ implies (5.1) and we 
complete the proof of assertion (i). 

For the proof the assertion (ii), notice 

ky{y, r) = y{ky, kr) for all k > 0, {y, r) G TZ. 

therefore we just need to consider (y, r) = (l,p) for some p € V. Lemma 5.2 implies F G 
M{p) ^ y{l,p), and the existence oi Y y & ^A{p) takes care of the existence F ;^ G 
M{p), P-a.s. 

The second part is a direct consequence of the definition of 3^(y,r). □ 
For the proof of Theorem 4.1, we will also need the following lemmas: 



Lemma 5.4. Under assumptions of Theorem 4.1, the value function u is (—00, oo)-valued 
on T-L. 



Proof. First, by Lemma 2.1, the assumption ^E'olt^] < 00 implies that for any positive 
constant s > 0, the existence of si > and ,82 > such that for all t G [0, T]: 



(5.7) 



U{t,x/s) > SiU{t,x) + S2, x > 0, 



According to Assumption (3.4) and the proof of Proposition 5.1, for each fixed pair (x, z) G 
■H, there exists A = A(x,z) > such that G A{x,z)^ therefore we deduce that xwt G 

l(f x,f z), and 



xp xp 
u{^x,-z) 



sup 



E 



T 



U{t,ct)dt 



> E 



U{t, xwt)dt 



> —00, 



hence, for any (x, z) G Ti, we get the existence of a constant s(x, z) > 0, such that u{sx, sz) > 
—00, with s{x,z) = 

Since, for any constant s > 0, 

A{x, z) = A{sx^ sz)/s, 

we derive u{x,z) > —00 if u{sx,sz) > —00 holds for a constant s = s{x,z) > , follow the 
result above, we conclude that u{x, z) > —00 in the whole domain H. 

Now, since the set H is open and u{x,z) < 00 for some {x,z) £ H hy assumption (4.6), 
we deduce that u is finitely valued on Ti by the concavity of u on 7^. And the proof is 
complete. □ 

Before we state the next lemma, let's introduce a special concept of compactness which 
was originally defined in Zitkovic [33]. 
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Definition 5.1. A convex subset C of a topological vector space X is said to be convexly 
compact if for any non-empty set A and any family {Fa}aeA of closed, convex subsets of C, 
the condition 

yD G Fin{A), Pi / ^ fj ^ ^ 

aeD a<=A 

where the set Fin{A) consists of all non-empty finite subsets of A for an arbitrary non-empty 
set A. 

Without the restriction that the sets {Fa}a£A must be convex, this definition would be 
equivalent to compactness in the original sense. Thus any convex and compact set is convexly 
compact and Definition 5.1 extends the concept of compactness. 

Zitkovic [33] furthermore derived an easy characterization on the space of non-negative, 
measurable functions, see Theorem 3.1 of Zitkovic [33] which states that 

Theorem 5.1. A closed and convex subset C o/L^j. is convexly compact if and only if it 
is bounded in finite measure. 

Based on the above theorem, we have the following lemma on the convex compactness of 
sets A{x,z) and y{y,r) : 

Lemma 5.5. For each pair {x,z) S Ti and {y,r) € TZ, the sets A{x,z) and y{y,r) are 
convex, solid and closed in the topology of convergence in measure P. Moreover, they are both 
bounded in x [0,T],O,F), hence they are both convexly compact. 

Proof. For (y, r) G TZ, we now define two auxiliary sets as 

Sj{y,r) = ^{x, z) G H : — zr < l| 

^^•^^ m= U ^(^'^)' 

{x,z)skij {y,r) 

and denote by 2t(A;) the closure of 2t(A;) with respect to convergence in measure P. 
From Proposition 5.1, we deduce that 

r€y{y,r) ^ (a,r><i, Vce2i(i) 

Hence, sets y{y, r) and 2t(l) satisfy 

S5(y,r)=a(l)°. 

At the same time, by its definition, we have 21(1) itself is closed, convex and solid, by the 
Bipolar theorem in Brannath and Schachermayer [2], we have 21(1) = 2t(l)°°, and hence we 
have the following Bipolar relationship: 



(5.9) 



21(1) = 3^(y,r) 
5^(y,r) =21(1)°. 
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The Bipolar theorem on L^|_ gives the convexity, sohdness and closure in measure P. 
Similarly, for {x, z) € 71, now define the set: 

z) = {(y, r) G TZ : xy — zr < 1}, 
(5-10) 2)(fc)A y 3;(y,^), 

and denote by 2)(A;) the closure of 2)(/c) with respect to convergence in measure P. 
Now, again Proposition 5.1 implies 

c G A{x, z) ^ (c, r> < 1, vr € ^ 

and the Bipolar relationship: 

(5.11) ^ ^ ' J ^ 

A{x,z) = mr- 

Hence, we also have A{x, z) is convex, solid and closed in the topology of convergence in 
measure P. 

Moreover, thanks to the existence of ^ F € M.{p) which is also in 3^(1, p), we deduce the 
set A{x, z) is bounded in measure P by Proposition 5.1 part {i). 

Similarly, as in the proof of Proposition 5.1, we have derived the existence of A = A(x, z) 
such that ^ pt = jWt € A{x,z), due to Proposition 5.1 part (ii), we get the set y{y,r) is 
also bounded in measure P. And therefore both of them are convexly compact in L^}_. □ 

A major difhculty arises in the proof of the existence of the dual optimizer in our setting 
due to the lack of integrability of the dual process T G y{y, r) for [y, r) € TZ. In fact, the 
trick of applying de la Vallee-Poussin theorem in the proof of Lemma 3.2 in Kramkov and 
Schachermayer [20] and Lemma A.l in Karatzas and Zitkovic [17] does not work. And the 
argument of contradiction mimicking the proof of Lemma 1 in Kramkov and Schachermayer 
[21] using the subsequence splitting lemma will also fail by observing the constant may not 
be contained in the dual space. Contrary to the results in the literature, much effort has 
to be made to modify the classic analysis, where the Assumptions of 74£'[C/]o < oo and 

E U {t, xwt)dt > — oo are critical for the procedure of our proof of the following lemmas. 
Lemma 5.6. Under assumptions of theorem 4.1, we have for each fixed {y,r) € TZ 



sup E 

rey{y,r) 



r v~{t,Tt)dt 

Jo 



< oo. 



Proof. Assumption (3.4) admits the existence of xwt € L*]. such that 



E 



/q U{t,xwt)dt 



> — oo, and moreover, by the proof of Proposition 5.1, we also know for 



each fixed (y,r) G TZ, find the fixed pair {x,z) G f){y,r), there exists a constant X{x,z) > 
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such that w G where p is defined by (3.19). Taking into account the inequahty U {t, x) < 

V{t, y) + xy, we have for any F G y{y, r) and yo(i) — inf{y > : V{t, y) < 0} 



T 



E 

< - E 

< - E 







V-{t,Tt)dt 

T 



< -E 



U {t, xwt)dt 



+ xE 



P 

U{t^xwt)dt + X— + X / yo{t)dt, 









[ wtTtdt 


+ xE 


a 


Jo J 







T 



Mvoit) - Tt)l{rt<yomdt 



T 



which is finitely valued and independent of the initial choice of F since we have Wt — 
gIoi-<^v)dv < 1 for t g [0, T] and sup yo{t) < cx) by Assumption (2.12), and thus our conclu- 

t6[0,T] 

sion holds true. □ 



Lemma 5.7. Under assumptions of Theorem 4.1, we have for any {y,r) ^TZ, yV (-jF.) 
is uniformly integrable for all F € y{y,r). 

Proof. By Corollary 2.1, the assumption A£^o[t^] < cxd is equivalent to the following 
assertions: 



(5.12) 



3yo > 0, and fi G (1,2), Vy > yo, Vit,2y) > fiVit,y). 



Let yo > and n G (1,2) be the constants in the above (5.12). Take 7 = log2 /U G (0, 1), 
we define the auxiliary function V{t, y) : [0, 00) x (0, 00) — > R by 



(5.13) 



-^V'{t,2yo)- V{t,y), y>2yo, 

7 



V{t,y) 



F(t,2yo)-^nt,2yo)(4 



y < 2yo- 



For each fixed t > 0, V{t,y) is a nonnegative, concave, and nondecreasing function which 
agrees with — V{t, y) up to a constant for large enough values of y and satisfies 



(5.14) 

Lemma 5.6 asserts 



V{t,2y) < fMV{t,y), for ah y > 0. 



sup E 



V-{t,Tt)dt 



< 00, 



and hence in light of the fact that V and V differ only by a constant in a neighborhood of 
00, we will get 



(5.15) 



sup E 

T&y{y,r) 



Vit,Tt)dt 



< 00. 



The validity of uniform integrability of the sequence I V (^F") I for F*^ G y{y,r), is 

V / n>l 

therefore equivalent to the uniform integrability of ( F(-, F"))„>i. 
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To this end, we argue by contradiction. Suppose this sequence is not uniformly integrable, 
then by Rosenthal's subsequence splitting lemma, we can find a subsequence (/")„,>i, a 
constant e > and a disjoint sequence {A'^)n>i of {Q x [0, T],0) with 



A"" GO, A'nA^ = if i / j, 



such that 



E 



vitjnundt 



> e, for n > 1 



We define the sequence of random variables (/i")n>i 

n 



k=l 



For any c G 21(1), 



Hence ^ G y{y,r). 
One the other hand, 



{c,h^)<^{c,f)< 



n. 



k=l 



E 



Jo Jo 



> en, 



and therefore by taking n = 2™, via iteration, it produces 



/i"^ sup E 



T 



v{t,rt)dt 



> E 



T 



V{t,hl )dt 



> 2'"e, 



since /x G (1,2), this contradicts (5.15) for m large enough, therefore the conclusion holds 
true. □ 

Lemma 5.8. For any pair {y,r) G TZ such that v{y,r) < oo, the optimal solution T* to 
the optimization problem (4.5) exists and is unique. 

Proof. Now fix (y, r) G TZ, let (r")„>i be a sequence in y{y,r) such that 

10 



hm E 



V{t,r^)dt =v{y,r). 



There exists a sequence of forward convex combinations /" G 
conv{T"',T"'~^^ , . . .) which converges almost surely to a random variable T* with values in 
[0,oo]. Since the set y{y,r) is closed and bounded in measure P in by Lemma 5.5, we 
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deduce that T* is almost surely finitely valued, moreover, F* belongs to y{y,r). We claim 
that r* is the optimal solution to (4.5), that is 



E 



T 



V{t,r*,)dt =v{y,r). 



The concavity of V produces 



hm E 

n— >oo 



Vitjndt <viy,r), 



and Fatou's lemma implies 



lim inf E 



> E 









V+{t,Tl)dt 



The optimality of will follow if we can show 



(5.16) 



lim E 

n— >oo 



T 



v-itjndt 



= E 









v~it,T:)dt 



but the validity of (5.16) is a consequence of Lemma 5.7. 



□ 



For the proof of conjugate duality relations between value functions u{x,z) and v{y,r), 
similar to the proof of Lemma 11 of Hugonnier and Kramkov [15], we have the following 
general result: 

Lemma 5.9. If Q L*! is convex and contains a strictly positive random variable. Then 



supE 



U {t, xgt)dt 



sup E 

g&clQ 



T 



U {t, xgt)dt 



X > 



where clQ denotes the closure of Q with respect to convergence in measure 
Lemma 5.10. For Wt = e-^o(~"")'^''j we have the following result: 



(5.17) 



E 



r v~{t, u'{t,wt))dt 

Jo 



< oo. 



E 



Proof. Similar to the proof of Lemma 5.6, recall the Assumption that 

U {t, xwt)dt > — oo, taking into account the inequality U (t, x) < V{t, y)-\-xy, we have 
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for any yo{t) ^ mf{y > : V{t, y) < 0}, 
rT 



(5.18) 



E 

< - E 



< - E 



V^it, U'{t,wt))dt 



T 



V{t, U'{t,Wt)l{u'{t,wt)>yo{t)} + yo{t)l{u'(t,wt)<yo{t)})dt 



T 



U{t, xwt)dt 



wt U'{t, wt)dt 



T 



< - E 



T 



U {t, xwt)dt 



wtU'{t,wt)dt +x yo{t)dt 



We already know the first term and the third term are bounded, as for the second term, we 
have two different cases: 

1. If we have x < 1, then we can rewrite the second term as 



E 



T 



Wt U'(t, wt)dt 



= E 

+ E 



Wt U'{t,wt)l{u,,<xo}dt 
Wt U'{t,wt)l{u,t>xo}'it 



where xq is the uniform constant in Corollary 2.1 such that for all t G [0,T], 



(5.19) 



xU'{t,x) < 



7 



1-7 

Again, use the fact that w ^ 1, we have 

T 



U {t, x)] for < X < xq. 



E 



wt U'{t,wt)l{u,t>xo}dt 



< oo. 



and we also have 



E 



T 



Wt U'{t,Wt)l{u,t<xo}dt 



< 



< 



7 



1-7 

7 

1-7 



U{t,wt)dt 



U {t, xwt)dt 



< oo, 



by using the inequality (5.19), the increasing property of U{t,x) with respect to x and the 
Assumption (3.4). 

2. If we have x > 1, then we rewrite the second term as: 



E 



T 



Wt U'{t, wt)dt 



E 



+ E 



Wt U'{t,Wt)l{.j:yj^<^o}dt 
Wt U'{t,Wt)l{s:wt>xo}dt 
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where xq is the uniform constant in Corollary 2.1 such that for all t € [0, T], the inequality 
(5.19) holds and moreover, 



(5.20) 



1 1 i_ 

U(t,-x)>(-) i-^f7(t,x) forO<x<xo, 

X X 



holds for all t € [0,T]. 

Then, again, the second term is bounded since xw ^ x, and for the first term, we have 



E 



T 



Wt U'{t,Wt)l{xwt<xo}dt 



< 



< 



7 



1-7 



E 



U{t,wt)l{swt<xo}dt 



1 

^_V_)-t^e[ / U{t,xwt)dt 
1 -7/ X L^o 



< 00, 



by the inequality (5.19) and (5.20) and the Assumption (3.4). 

Hence we proved the second term in (5.18) is also finite, and we can therefore conclude 
that result (5.17) holds true. □ 

We should again emphasize the fact that the auxiliary dual domain 3^(y, r) is not necessary 
a subset of , and hence we have to revise the usual Minimax theorem based on to derive 
the important conjugate duality relationship. Fortunately, the following Minimax theorem 
proved by Kauppila [18] can serve as a substitute tool on the space L!]_. 

Theorem 5.2 (Minimax Theorem). Let A be a nonempty convex subset of a topological 
space, and B a nonempty, closed, convex, and convexly compact subset of a topological vector 
space. Let H : A x B ^ be convex on A, and concave and upper- semicontinuous on B. 
Then 

sup inf H = inf sup H. 

B A A B 

See the detail proof in Theorem A.l in Appendix A by Kauppila [18]. We remark this 
Minimax Theorem is a relaxed version of Theorem 4.9 by Zitkovic [33]. Contrary to the 
assumption of Zitkovic [33] that the target functional needs to be semi-continuous with re- 
spect to both vector spaces, Kauppila [18] only requires the functional has semi-continuity 
property on one of the vector spaces, which can be applied to our case. 



Lemma 5.11. Under assumptions of Theorem 4.1, the conjugate duality relations hold: 
(5.21) 



u{x,z)= inf {v{y,r)-\-xy — zr}, {x,z)€7i, 



v{y,r) = sup {vl{x , z) — xy + zr} , (y, r) € 7^. 

Proof. For n > 0, we define 5„ as a subset in L^(r2 x [0, T], 0,F) as 

5„ = {c G L° : ^ c ^ nw}. 
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It is clear that sets 5„ are closed, convex, and bounded in probability, and hence convexly 
compact in iJ^. 

We will first show that the functional 



T 



U{t,ct)-ctrt]dt 



is upper-semicontinuous on Sn in the topology of convergence in measure P, for all T € y{y, r) 
and (y, r) € TZ: 

In fact, by passing if necessary to a subsequence denoted by {c^)m>i converges almost 
surely to c E 5„, Fatou's lemma implies both 



(5.22) 
and 



lim inf E 



T 



> E 









u{t,ctydt 













(5.23) 


lim infE 


/ SlTtdt 


> E 


/ ctVtdt 











Moreover, on 5„, it is clear that E 

rT 



(5.24) 



lim E 

m—^oo 



u{trcTrdt 

U{t,cT)+dt 







E 



is uniformly integrable, and hence 

T 

U{t,ct)+dt 







Now, together with (5.22) and (5.23), we have 

f-T 



lim supE 







u{t,cT)-cTrt dt 











< E 





U{t,ct)-ctTt]dt 



Noting that, by Lemma 5.5, y{y, r) is a closed convex subset of L^{_, we may use the above 
Minimax Theorem 5.2 to get the following equality, for n fixed: 

sup inf e[ / (u{t,ct)-ct^i)dt\= inf supE[ / (u{t,ct)-ct^i]dt 

Recall now the Bipolar relationship (5.9), and from the definition, we have 
(5.25) IJ A[x,z) = \]^{k). 

As a preparation of the following proof, we define the auxiliary set 



and clearly, we also have 
(5.26) 



2t'(A;) 4 |c e %(k) ■ sup (c, r) = k\ 



(J2l(fc)= U A(x,z)=\^^{k). 
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We show first that 



(5.27) 



hm sup inf E 

"^°°cG5„rgy(y,r) 



sup sup inf E 

k>OceW{k)r£y(y,r) 



U{t,Ct)-CtTt)dt 



U{t,ct)-ctTt)dt 



The direction of inequality ">" holds by 



lim sup inf E 

"-^°°ce5nrGy(y,r) 



> lim sup inf E 



U{t,ct)-ctTt)dt 



U{t,ct)-ctrt)dt 



= sup inf E 

cga'(fc)rey(s/,r) 



T 



U{t,ct)-ctTt)dt 



yk > 0, 



while the other direction "<" is obvious since for any {x, z) G we have nw G %'{np), and 
hence Sn C 21' (np). 

To show the next step, we need to prepare some finiteness results as below: 

From definitions in Lemma 5.5 and by Lemma 5.9, we know 



T 

(5.28) sup E / U{t,ct)dt 

ce21(A:) 

and we claim that 
(5.29) 



sup E 

cG2l(fe) 



U{t,ct)dt 



sup u{x, z), k > 0, 

{x,z)£kSj{y,r) 



sup u{x,z) < oo. A: > 0. 

{x,z)Gkf){y,r) 

To prove (5.29), recall that the set TZ is open, the set S){y, r) is bounded and (5.29) follows 
from the concavity of u and u{x, z) < oo for all (x, z) G "H. 

Now, by (5.26), (5.29) and the definition of domain Ti, we have further equalities: 

rT 



sup sup inf E 

k>Oc&'{k)rey{y,r) 



U{t,ct)-ctTt)dt 



-supl sup E 
fc>o ^ce<H'{k) 



U{t,ct)dt 




T 







=sup< sup E 

fc>o cea{A:) 

=sup< sup u 

k>0 ^{x,z)ekf:{y,r) 

= sup {u{x, z) — xy + zr}. 

{x,z)eH 



U{t,ct)dt 
{x,z) - A;| 



On the other hand, 



inf sup E 

r&y{y,r)c£S„ 



U{t,ct) -ctTt)dt 



inf E 

rey{y,r) 



y"(t,r4,a;)dt ^t)"(2/,r) 
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where we define V'^{t, y,uj) according to the definition of set 5„ as 

V"'{t,y,uj) = sup U{t,x) — xy 

0<x<nw '- 

Consequently, it is sufficient to show that 

lim {i"(y,r) = lim inf e\[ V{t,Tt,uj)dt\ = v{y,r), {y,r) elZ. 

Evidently, v'^{y,r) < v{y,r), for n>l. Let (r")„>i be a sequence in y{y,r) such that 

rT 



lim E 

n— >oo 



V''{t,T^,uj)dt = lim i)"(j/,r). 



Then we can find a sequence /i" € conv{T^ ,T'^~^^ , . . .), > 1, converging almost surely 
to a variable F. We have T G 3^(y,r), because the set y{y,r) is closed under convergence in 
probability. 

Now, we claim the sequence of processes {V''^{-,h"',uj)~),n > 1 is uniformly integrable, 
and in fact, we can rewrite 



(5.30) ^V^it,h^,u;)) = l{hf<U'itM)} + [y''it^h^^u;)) l{,.>^.(i,^,)|, 

and since V'^{t,y,ijj) = V{t,y) for y > U'{t,wt) > U'{t,nwt) by the definition. The 
argument from Lemma 5.7 asserts the uniform integrability of the sequence of processes 

On the other hand, by the monotonicity of we have for all n > 1, 



(5.31) (y"(t,/ir,u;)j l{hf<u'{t,u,,)} < [V\t,hl\uj)) l{hY<u'{t,u„)} < [V{t, U'{t,wt)) 

and by Lemma 5.10 the right hand side is integrable in the product space, and hence we 

conclude the sequence (^V^ {■ , h"" , u)^ l{h"< (7'(-,u).)}' ^ 1 is also uniformly integrable, and 
hence our claim holds true. Moreover, we will have the following inequalities: 



hm E 

n— >oo 



>lim infE 

n— >oo 



>E 



Vit,Tt)dt >viy,r), 



which proves: 
(5.32) 



v{y,r) = sup {u{x , z) — xy + zr} . 

(x,z)eH 



For the other equality (5.21), define the function f{x, z) from to M as 

^ f cl{—u{x,z)) {x,z) G clT-L, 



(5.33) 



f{x,z) 



oo. 



otherwise. 
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where cl{—u{x,z)) is the lower semicontinuous hull of function —u{x,z). Then f is a proper, 
convex and lower-semicontinuous function on M and notice int{dom{f)) = H. By Corollary 
12.2.2 in Rockafella [26], its Legendre-Fenchel transform is defined by 

f{y-,f)= sup {—xy + zr — f{x,z))= sup {—xy + zr + u{x,z)), (y,r)e]R^. 

Observe that if {y,r) € TZ, we have f{y,r) = v{y,r) by (5.32), and if (y,r) ^ clTZ, we have 
by the increasing property of u{x, z) that 

/(y, r) > s{-xoy + zor) + u{xo, zq) 

for any s > 1 and fixed {xq,zo) € Ti. We can therefore conclude that f{y,r) = oo for 
{y, r) ^ c/T^ since —xoy + zq^ > by the definition of TZ. We can thus apply Theorem 12.2 in 
Rockafella [26] to derive that 

f{x,z)= sup {—xy + zr — f{y,r)), V(x, z) G M^. 

(s/,r)GM2 

Again, by Corollary 12.2.2 in Rockafella [26] and the fact that 
int{dom{f)) = int[dom{v)) C 7^, we further have 



f{x,z)= sup (— + zr — {'(y, r)) 
In particular, we deduce that relation 



inf {v{y,r) + xy — zr), V(x,z)€M^. 

(2/,r)G7^ 



{t(x,z)= inf {v{y,r)+xy — zr}, \/{x, z) £ Ti, . 
(^/,r)G7^ 



□ 



PROOF OF THEOREM 4.1. 

It is now sufficient to show the conjugate value function v is (— cxd, oo]-valued on TZ. 
Now, according to the definition of Legendre-Fenchel transform, we have 

U{t,x) < V{t,y) + xy 

by integration, it is easy to see for any c E A{x, z) and F G 3^(y, r), we have 



E 



< E 



V{t,Tt)dt 



+ E 



T 



ctTtdt 



U{t,ct)dt 

from which Proposition 5.1 deduces that 

u{x, z) < v{y, r) + xy — zr, 

and hence we obtain for all {y, r) G TZ, we have v{y, r) > — oo by Lemma 5.4. 

On the other hand, thanks to conjugate duality (5.21) and Bipolar relationship (5.9), follow 
the proofs in Lemma 5.5 and Lemma 5.11, we also have for each fixed (y,r) G TZ 

sup u{x, z) = mi{v{sy, sr) + ks}. 

{x,z)ek?){y,r) 

The finiteness result (5.29) for all /c > in the proof of Lemma 5.11 guarantees the existence 
of a constant s{y,r) > 0, such that v{sy,sr) < oo. □ 
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5.2. The Proof of Theorem 4.2. Let's move on to the proof of Theorem 4.2, to this end, 
we win need some further lemmas and priori results. 



Lemma 5.12. Under assumptions of Theorem 4.2, we have v{y,r) is {—oo,oo) -valued on 

n. 

Proof. Similar to the proof of Lemma 5.4, under the additional Assumption (2.9), we 
can show v{y,r) < cx) if v{sy,sr) < oo for a constant s = s{y,r) > 0. And we have shown 
that Theorem 4.1 asserts the existence of s = s{y,r) > 0. □ 

We wish to draw the reader's attention that we can not simply mimic the proofs of Lemma 
5.6, 5.7 and 5.8 to obtain the existence and uniqueness of our auxiliary primal Utility Maxi- 
mization Problem (3.22). In fact, our successful arguments for the dual problem are hinged 
on the existence of a bounded process w € 2l(^), which is missing in the dual space. Never- 
theless, the prescribed assumptions on the Reasonable Asymptotic Elasticity permits us to 
interplay the primal optimizer to the optimal solution to some dual problems. To this end, we 
resort to a further auxiliary optimization problem of the Auxiliary Dual Utility Minimization 
Problem (4.5), and make advantage of the Bipolar results built in Lemma 5.5. 

Lemma 5.13. Define the auxiliary optimization problem to the Auxiliary Dual Utility 
Minimization Problem (4.5) as: 



(5.29) 



v{k) = inf E 
r6?)(fc) 



Vit,Tt)dt 



where 2) (A;) is defined in Lemma 5.5 as the bipolar set of A{x, z) on the product space for any 

{x,z) G n. 

Then, for all k > 0, under hypothesis of Theorem 4.2, the value function v{k) < oo for all 
k > 0, and the optimal solution T{k) exists and is unique and Tt{k) > for all t G [0,r]. 
Moreover, for each k > 0, and any T € 2)(A;), we have 



E 



{Tt-rt{k))i{t,tt{k))dt 



< 0. 



Proof. According to the definition in Lemma 5.5, it is easy to see 



v{k) 



inf E 

rG2j(fc) 



V{t,Tt)dt 



< inf E 

re?Kfc) 



V{t,Tt)dt 







= inf v{y,r) < oo,k > 0. 

{y,r)ek<n{x,z) 



by Lemma 5.12. ^ 

Taking into account the Bipolar relationship (5.11), we have ^{k) is convexly compact in 
L'}_, the existence and uniqueness of optimal solution r(A:) will follow the similar proof of 
Theorem 4.1. 
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Now, for > 0, e G (0, 1) and define ^ = {l-e)rtik) + eTt, for all t G [0, T], the optimality 
of T{k) implies 



(5.30) 



<-E 
e 

1 

<-E 
e 



v{t,rt)-vit,rtm)dt 



rt{k)-rt)i{t,rt)dt 



T 



Tt{k)-rt)i{t,Ti)dt 



We claim the family ^(^{Tt - tt{k))I{t,ri) 
respect to P, since first 



.e G 



(0,1) I is uniformly integrable with 



iTt-Ttik))I{t,Tl)) <Ttik)Iit,Tt) <rtik)Iit,il - e)Ttik)), VtG [0,r]. 
We fix eo < 1 and observe that for e < eo, we have for each t G [0, T], 



tt{k)I{t,{l-e)rt{k)) < tt{k)I{t,il-e)rt{k)) 



{rt{k)<yi} 



+ 



Ttik)Iit,{l-e)Ttik)) 



^{ft(fc)>T^} + 



Ttik)Iit,{l-e)ttik)) 



{yi<r,(fc)<^}- 



Now fix eo < 1 and observe that for e < eo, recall by Lemma 2.1 and Corollary 2.1, 
assumptions on Reasonable Asymptotic Elasticity A£'o[f/] < oo and AEoo[U] < 1 imply for 
fixed /i > 0, the existence of constants Ci > 0, C2 > 0, yi > and y2 > such that 



(5.31) 



-V'{t,fiy)<Ci^^^^^ for0<y<yi, 

y 

-V'{t,y)<C2^^^^ fory2<y. 



Hence, the first term is dominated by 

fi(fc)/(t,(l-e)f,(A;)) 
and the send term is dominated by 



< 



{rt(fc)<?/i} - 1 



-CiV{t,Tt{k)), 



rt{k)i{t,ii-e)ttm 



<- 



<- 



1-eo 



-C2V{t,{l-e)ttm 
C2V{t,tt{k)). 



These two terms are both in by the finiteness of v{k). On the other hand, the third re- 



maining term 



Ttik)Iit,il-e)Tt{k)) 



1, 



^{.yi<f,(fe)<^} is dominated by krt{k)l^y^^f.^^^^^_y^^ 
for a constant A; > 0, and it is obviously integrable as well. 

Now we can let e — )■ and apply Dominated Convergence Theorem and Fatou's Lemma to 
obtain the stated inequality. 
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To show the optimal solution tt{k) > for all t S [0, T], choose an element > E 2)(A:) 
for all t € [0, T], it is enough to rewrite the inequality (5.30) as 
(5.32) 



> E 



T 



(fe)>0} 



dt 



+ E 



T 



(fc)=0} 



dt 



Now suppose P{f J (/c) = 0} > 0, then by the uniform integrability of | ^{Tt—Tt{k))I{t, T 

(0, 1)| , let e converges to 0, the second term of (5.32) goes to oo, since I{t, 0) = oo and > 
for all t G [0,T], and we obtain the contradiction. Hence the conclusion holds. □ 

Lemma 5.14. Under Assumptions of Theorem 4.2, the auxiliary dual value function v{k) 
is continuously differentiable on (0, oo), and 

f-T 



(5.33) 



kv'{k)=E / rt{k)I{t,Tt{k))dt 



Proof. In order to show v{k) is continuously differentiable, notice the convexity property, 
it is enough to justify that its derivative exists on (0, oo). Now fix A; > 0, and define the 
function 



h{s) 



E 



v{t,-rt{k))dt 



This function is convex and by optimality of F(A;) of problem (5.29), we have h{s) > v{s) 
for all s > and h{k) = v{k). Again, by convexity, we obtain 

A'h{k) < A-v{k) < A+v{k) < A+h{k), 

where A"*" and A~ denote right- and left-derivatives, respectively. Now 

h{k + e)-h{k) 



A+h(k) =lim 

e-i-O 



: lim -E 

e^O e 



e 

^ 'V{t,^tt{k))-V{t,tt{k))]dt 







e^O 
1. 



1 



<liminf( - 77 IE 



k 

^ ett{k)I{t,^tt{k))dt 



k 



k 



-E 



ft{k)I{t,ft{k))dt 



by the Monotone Convergence Theorem. 
Similarly, we get 



A'h{k) > limsupE 

e-^0 



tt{k)I{t, ^ft{k))dt 



We can follow the same reasoning as in Lemma 5.13 to show the family 

{(Tt{k)I{t, ^^rt{k)) ) , e E (0, 1 A k)} is uniformly integrable, and Dominated Convergence 



rtik)i{t,ttik))dt 



Theorem and Fatou's Lemma produce that 



A-h{k) > 



1 



E 
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which completes the proof. □ 
Lemma 5.15. The auxiliary dual value function v{-) has the asymptotic property: 

(5.34) - v'{0) = oo, -v'{oo) = 0. 

Proof. We first show —v'{0) = oo, and to this end, we can first derive the result that 

(5.35) 



w(0+) > [ V{t,0+)dt. 
Jo 



To prove the validity of (5.35), we observe that for any > 0, by the definition we have 



v{k) =Ie[ / V{t,rtik))dt 



= E 









T 



v+{t,rt{k))dt 



-E 









V-{t,tt{k))dt 



hence, by Fatou's Lemma, firstly, we have 

limE[ / V+{t,rt{k))dt 
fc->o L Jq 



(5.36) 



> E 









V+{t,0+)dt 



On the other hand, similar to the proof of Lemma 5.6, we can show that 

rT 

E I V~{t,tt{l))dt < oo. 



JO 



and therefore, by the Monotonicity of function V (t, •) and Dominated Convergence Theo- 
rem, we can easily derive that 



liniE 

fc-^O 



V-it,ttik))dt 



= E 









V~{t,0+)dt 



which together with (5.36) implies that (5.35) holds true. 

Therefore, if V{t,0+)dt = oo, then we have v{0+) = oo, and by convexity, we have 
v'{0+) = -oo. 

In the case V(t,0+)dt < oo, we then have 

vm-v{k) fo Vit,0+)dt-E\j;[ V{t,ttik))dt 
- v(0+) > lim — — > lim ■■ 

k^O k k^O k 



and hence we have 



E 



-v(0+) > lim ■ 

k^o 



> limE 

fc^O 



Vit,0+)dt -E V{t,ft{k))dt 



k 



tt{i)i{t,krtii))dt 



oo. 



by the Monotone Convergence Theorem. 

We can now turn to show that —v'{oo) = 0, and since the function —v is concave and 
increasing, there is a finite positive limit 

— v'{cx>)= lim —v'{y). 
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By the definition of Legendre Transform, we clearly have for any y > 0, 

- V{t, y) < - U{t, x) + xy, for all x > 0, 
and then for any e > 0, we always have: 



< —v'{oo) = lim 



-v{k) 



E 



fe— >oo k 



lim ■ 

k—>oo 



/o^-F(t,fi(A;))dt 



E 



< lim ■ 



-Uit,ewt)dt 



+ lim ■ 

k k^oD k 

Now, recall that for each fixed {x,z) G Ti, there exists a constant X{x,z) > such that we 

~'P^ P. ~ 



[ew 



have wt € A{jx, jz), and by the definition of 2)(/c), we can see the second term above has 



fc— >-oo k k-^oo k 



p 



As for the first term, we claim that E 



< oo for each fixed e small enough, 



/q -U{t,ewt)dt 

without loss of generality, we just need to consider that e < x, and then we will apply Corollary 
2.1 again, and since there exists a constant xq such that for all t £ [0, T], 

U(t, 4x) > 1^ U(t, X) for < X < Xq, 

X X 



we will have 



E 



U{t,ewt)dt 



= E 
+ E 
< E 



T 







-U{t,ewt)l{xwt>xo}dt 

-U{t,eWt)l{s:wt<xo}dt 

-U{t,ewt)l{swt>xo}dt 

T 

— U {t, xwt)dt 



+ (-^)~^E 

X 



by the fact that w <1 and the Assumption (3.4). 
Hence, we conclude that 

., , —v(k) p 

< (oo) = lim — ^ < e^, 
fc— >-oo k A 

and consequently, we have — 'O'(oo) = by letting e goes to 0. 



< oo 



□ 



Lemma 5.16. Under assumptions of Theorem 4.2, for any {x,z) € 7i, suppose k satisfies 
1 = —v'{k) where v{k) is the value function of the auxiliary dual optimization problem (5.29) , 
then c*{x,z) = I(t,Tt{k)) is the unique (in the sense of= inlJ\_) optimal solution to problem 
(3.22), moreover we have c^{x,z) > 0, P-a.s. for all t £ [0,T]. 
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Proof. Lemma 5.14 asserts 

{c*{x,z),t{k)) = -kv'{k) = k. 

And for any T G 2)(A;), by Lemma 5.13, we have 

{c*ix,z),r{k)) < {c*ix,z),tik)) = k. 

Hence, we get first cl{x,z) S A{x,z) by the Bipolar relationship (5.11^ 
Now, for any c S A{x, z), we have 

{c,t{k)) <k, 
U{t,ct) <V{t,tt{k)) + cttt{k), Vt G [o,r]. 



It follows that 



E 



(5.37) 



U{t,ct)dt <v{k) + k = E 

r-T 



T 



=E 



V{t,Tt{k))+TtI{t,Tt{k))]dt 



U{tJ{Tt{k)))dt 



E 



U{t,cl)dt 



which shows the optimality of c*. The uniqueness of the optimal solution follows from the 
strict concavity of the function U . 

Moreover, under assumptions of Theorem 4.2, for any pair {x,z) G Ti, by the fact that 
2) (A;) is convexly compact and Tt{k) is bounded in probability, we actually have the optimal 
solution c*{x,z) > 0, P-a.s. for all t G [0, T] since Tt{k) is bounded in probability if and only 
if Tt{k) is finite P-a.s. and by definition, we know I{t,x) > for x < oo. □ 

For the proof of Theorem 4.2, we shall also need the following lemma. 

Lemma 5.17. Assume that the assumptions of Proposition of 5.1 hold true. Let the se- 
quences {y^,r"') G TZ and L" G y{y'^,r^), n > 1, converges to {y,r) G M? and T G L^j,, 
respectively. IfT is a strictly positive random variable, then {y,r) G TZ and T G y{y,r). 

Proof. Let {x, z) G clT-l and c G A{x, z) Let (x, z) G clH, the proof of Lemma 5.1 states 
there exists c G A{x, z) such that 

f[c >- 0] > 0. 
According to Proposition 5.1, we can get 

< (c, r) < — zr, 

by Fatou's lemma. 

As {x,z) is an arbitrary element in clH^ it implies that (y,r) G TZ. The conclusion that 
r G y{y,r) holds by applying Fatou's lemma and Proposition 5.1. □ 
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PROOF OF THEOREM 4.2. 

We first show the dual value function v{y, z) is continuously differentiable on IZ. Theorem 
4.1.1 and 4.1.2 in Hiriart-Urruty and Lemarechal [14] gives the equivalence between the above 
statement and the fact that the value function u{x,z) is strictly concave on H. Since U is 
a strictly concave function, to show the value function is strictly concave is equivalent to 
show for any two distinct points {xi,Zi) Ti, i = 1,2, the optimal consumption policies are 
different: 

F[C*{XI,ZI)^C*{X2,Z2)]>0, 

which is equivalent to Assumption (4.2). 

As for the remaining piece of the proof, it amounts to show the assertion (ii) hold, and 
recall T{k) is the optimal solution of the auxiliary dual problem (5.29), such that 

tt{k)= U'{t,cUx,z)), yte[0,T], k = {c*{x,z),t{k)). 

By the definition that 2)(A;) is closed with respect to convergence in measure P, there exists 
a sequence (y",r") € kyi{x,z) such that F" E y{y^,r'^) and F" converges to T{k) V-a.s. by 
passing to a subsequence if necessary, and since set k9\{x, z) is bounded, there exists a further 
subsequence {y^,r^) converges to (y,r) G ]R2_ gy 

passing to this further subsequence, as we 
have shown P[r(/c) :^ 0] = 1, we will have (y, r) G k^R{x,z) such that T{k) G y{y,r) due to 
Lemma 5.17. Moreover, for this pair (y, r) G TZ, by Fatou's Lemma and Proposition 5.1, we 
have the equality that 

(5.38) xy — zr = k = (c* {x, z),T{k)^ . 
And we have the corresponding optimizer Tl{y,r) of (4.5) verifies 

(5.39) Tl{y,r)=tt{k) = U'{t,c*{x,z)), 
because on one hand, we have T{k) G y{y,r), hence 

''^ V{t,Tl{y,r))= inf 
'0 rey(y,r) 

and on the other hand, we have 

cT f-T 
inf 

re?)(fc) 



E r V{t,Tl{y,r)) = inf E T V{t,Tt{y,r)) < E T V{t,tt{k)), 
Jo revfw.r) JO Jo 



e/ V{t,tt{y,r))= inf E / V{t,rt{y,r)) 
Jo re?)(fc) Jo 

< inf E r V{t,Tt{y,r))=E T F(t, F*(y, r)). 
r&y(v,r) Jo Jo 



By the equality 

U{t,cUx,z)) = V{t,tt{k)) + cUx,z)tt{k), 
we can conclude (y, r) G du{x,z) by Theorem 23.5 of Rockafellar [26], since we have 

(5.40) u{x, z) = v{y, z) + xy — zr 
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In particular, we get 

(5.41) du{x,z)nn^0. 

Similar to the proof of Theorem 2 in Hugonnier and Kramkov [15], we can actually show 

du{x, z) C TZ. 

For any (y, r) G (9tt(x, z), we can find a sequence (y", r") € 5u(a:;, z)n7^ converging to (y, r) by 
(5.41) and the fact that du{x^z) is closed and convex. Since [/'(•, c* (a;, z)) is strictly positive 
and we know U'{-,c*{x,z)) G y{y,r). Lemma 5.17 now infers {y^r) € TZ. 
Conversely, for any (y,r) G du{x^z), then 

t-T 



E 



=E 



y (t, Tl {y, r)) + (x, z)n (y, r) - f/(t, (x, z)) 



(it 



V{t, r*(y, r)) + c*(x, z)r*(y, r) - [/(t, c*(x, z))dt 



<v{y, r) + xy — zr — u{x, z) = 0, 
which infers (5.38) and (5.39). 



□ 



6. The Special Case When £ is Replicable. 

6.1. The One Dimensional Primal Value Function. We begin this section by describing 
the special case when the random variable defined by 

£^ r wtdt= /^e^'('^"-"")'^^'dt 



JO Jo 

is replicable, i.e., there exists a constant f > such that 
(6.1) {w,Y) = f, VyG>[, 

where M. is the set of all equivalent local martingale measure densities. 

In the light of the fact that p = p = f, where p and p are defined in (3.19) and (3.20), we 
see the closure of domain TZ for the pair (y, r) defined in (4.3) shrinks into a line, and hence 
the set TZ is not well defined. In order to build the similar conjugate duality, we will need to 
reconsider our primal utility maximization problem and the corresponding dual optimization 
problem, and embed our problem into the framework of Kramkov and Schachermayer [20], 
[21]. In particular, instead of defining the primal value function on two variables of initial 
wealth X > and initial standard of living z > 0, we can reduce its dimension and define 
the new variable x = x — zf. According to Lemma 3.1, the effective domain li for x and z 
mandating the constraint that x > zf can therefore be transformed to the constraint on the 
choice of X as X > 0. 

Recall the auxiliary dual set Ai is defined by 



M 



r G L° : Lt = yj + JtE ^ e^ti^-~'^-)'i^Ysds Tt . Vt G [0, T], Vy G 
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In order to invoke the one dimensional convex duality analysis in Kramkov and Schachermayer 
[20], [21], we first define the domain of the auxiliary processes c depending on the value of x 

as 



.2) 



A{x) = ^cG'LI: {d,r)<x, VreTW}, forS>0. 



Then, it is clear that we have the equivalence that A{x, z) = A{x) if we take x = x — zf. 

It is now ready to define the Auxiliary Primal Utility Maximization Problem with 
respect to c as 



(6.3) 



u{x) = sup E 



U{t,ct)dt 



X > 0. 



6.2. The Dual Optimization Problem and Main Results. We denote the set 3^(1) as the 
bipolar set of ^A in Lj_, i.e., 



(6.4) 



y{i) = M°° 



then we know the set 3^(1) is the closure of the solid hull of Ai, and we are ready to define 
the Auxiliary Dual Utility Optimization Problem as 



(6.5) 



v{y) 



inf E 



V{t,rt)dt 



Then, we have the following theorems which consist of the main results in this section 

Theorem 6.1. Assume conditions (2.5), (2.7), (3.4) hold. Assume also that (2.11), (2.12) 
and (2.10), {i.e., AEq[U] < oo) hold true together with 



(6.6) 

we will have: 



u{x) < oo for some x > 0, 



(i) The value function u{x) takes value (—00,00) for all i; > 0, v{y) takes value (—00,00] 
for all y > 0. And there exists a constant yQ > such that v{y) < 00 for y > yo- The 
value functions u and v are conjugate, 

v{y) = sup[u(x) - xy], y > 0, 
u{x) = sup['u(y) + xy], x > 0. 

3/>0 

(ii) The function u is continuously differentiable on (0, 00) and the function v is strictly 
convex on {v < 00}. 

(Hi) The functions u' and v' satisfy 

u'{0) = lim u'{x) = 00, —v'{oo) = lim —v'{y) = 0. 

i— >0 j;— >oo 



(iv) If v{y) < 00, then the optimal solution T^:{y) S 2/3^(1) to (6.5) exists and is unique. 
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Theorem 6.2. We now assume in addition to conditions of Theorem 6.1 that Assumption 
(2.9) holds, (i.e., AE^[U] < 1). Then in addition to assertions of Theorem 6.1, we also have: 

(i) v{y) < oo, for all y > 0. The value functions u is continuously differentiahle on (0, oo) 
and V is continuously differentiahle on (0, oo) and the functions v! and —v' are strictly 
decreasing and satisfy 

u{oo) = lim tt'(x) = 0, —v{0) = lim —v{y) = oo. 

(ii) The optimal solution c*{x) to (6.3) exists and is unique. IfT*{y) is the optimal solution 
to (6.5), where y = u'{x), we have the dual relation 

cl{i) = I{t,Tl{y)), Tl{y)=U'{tMx))- 

(Hi) For the choice of initial wealth x and initial standard of living z such that (x, z) € %, 
i.e., X > zf, we have the optimal solution to our primal utility maximization problem 
(3.10) exists and is unique, moreover, 

c:{x,z)-Z;{x,z) = cl{x), VtG [o,r], 

where we have x — zf = x. 

The proofs of Theorem 6.1 and part (i), (ii) of Theorem (6.2) are very similar to the proofs 
of Theorem (4.1) and (4.2) in Section 5 for the case when £ = Jq wtdt = e-^o(^^-°'^)<^'"dt 
is not replicable, and therefore will be omitted here. As for part (Hi) of Theorem (6.2), we 
just recall that if we have x — zf = x > 0, then A{x, z) = A{x) and there is a one-to-one 
correspondence between set A{x, z) for the consumption rate process q and the set A{x, z) 
for the auxiliary process q. 

We are now interested in a closer look at the dual domain 3^(1) = M°° . Recall the con- 
struction of the auxiliary set M , we know that each element F G is a linear transform of 
the equivalent local martingale measure density process Y Ai such that 



Yt + 6tE 



T 



e 



Tt 



,Vt € [0,T]. 



A natural question is whether the dual domain y{y) can be fully characterized by the same 
linear transform of supermartingale deflators defined in Kramkov and Schachermayer [20], 
[21], where we define the set y{y) as 

y{y) = |y € : Yq = y, XY is a supermartingale for X = x + H ■ S 
where H is admissible |, 

and define the corresponding auxiliary set y{y) by 

y{y) = solid(\T € L° : Tt = Yt + 6tE\ [ e-^t^^^-''^'^'^''Ysds Tt] , Vt € [0, T] 
(6.7) ^Jt J 

for y €3^(y)}). 
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Then 



(6i 



Question: Is it true that 3^(1) = ? 



If the answer is TRUE, then we can always redefine the dual problem over the set of 
supermartingale defiator Yt instead of the abstract auxiliary process Tt, i.e., we can define 
the dual optimization problem as: 



(6.9) 



viy) 



inf E 



Vit,Yt + 6tE 



i: 



and if the dual optimizer in (6.5) exists, we should always have the dual optimizer 

Y*{y) to the problem (6.9) exists and we have the equivalence that 



n(y) = l^;(y) + 5tE 



Unfortunately, the answer to the question (6.8) is not always yes. It is important to point 
out that the set y{y) is not necessarily closed due to the conditional expectation of the future 
path integral with respect to Yj. Actually, we have the following Lemma: 



Lemma 6.1. 
.10) 



y{y) = y{y)- 



where y{y) denote the closure of set y{y) on the product space L5]_. 

Proof. Without loss of generality, we just need to check the case when y = 1. First, it is 
trivial to show that 3^(1) ^ 3^(1) holds, since we clearly have A4 C y{l), and the set y{l) is 
closed, solid and convex set containing A4. 

To prove the other direction inclusion, it amounts to verify that 3^(1) C ^(1)°. By the def- 

converges to F a. s. in IP and F" ^ 

eft^^--°'-'^'^"Y^''ds 



inition, for each F € 3^(1), we can find a sequence ( F 



n>l 



F'" G 3^(1) such that there exists Y'^ € 3^(1) with Ff = y/"+(5jE 

[0, T]. So for each c € A{1), there exists a pair (x, z) ^ H with x — zf = x = 1, and by Propo- 
sition 3.1, there exists c € A{x, z) and we have 



(c, F) = (c, limF") < (c, limF'") = lim(c, F'") - zf < x - zf 



X 



1, 



and our claim holds, where we used Fatou's lemma and the fact that 3^(1) = and 
Consumption Budget Constraint to conclude that (|c, y'") < x — zr for each y" € 3^(1). 
Now, the fact that 3^(1) = -4(1)° implies that 3^(1) ^ 3^(1) which completes the proof. □ 

The optimal dual solution for the problem (6.5) is an abstract process in general, which 
does not provide any explicit financial intuitions with respect to the market. However, one 
special case we want to discuss in this section is to assume the discounting processes 5t and 
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at satisfies the condition that 6t — at is a deterministic function in time t. 
In this special case, it is clear that we can rewrite the auxiliary set A4 as 

7W = |r € L^^ : = Yt(l + 6t e^ti^--^'')d^ds^, G M^. 
And we will define another auxiliary dual domain by 

(6.11) y{y) = {r e : = yt(i + 5t e^t^^^-'^^^'^^'ds), vy e solid{y{y))y 

We want to show the following lemma holds, 

Lemma 6.2. If 5t — at is a deterministic function in time t, then 

(6.12) y{y) = y{y). 

Proof. Again, it is enough for us to prove the conclusion for y = 1. For one direction, 
since the set 3^(1) is closed, convex and solid, from the definition, it is also true that the set 
3^(1) is closed, convex and solid on L,^. Notice again that A4 C y{l), we can conclude that 
3^(1) ^ 3^(l)i a-s y{l) is the smallest closed, convex and solid set containing A4. 

One the other hand, by the fact that soHd{y{l)) = M°°, for any Tt = YtKt G 3^(1) where 
we denote Kt = ^1 + 5* e^^ {&v-av)dv ^ there exists a sequence of processes e 7W such 

that converges to Y . Therefore, we have for any c S ^(1) 

(c,r) = {c,YK) < lim(c,y"i^>, 

and since y" is a true martingale, we have 



Y/'Kt = y" + 6tE 



T 



e 



Jt{Sv-av)dvYn^g 



Tt 



Consequently, we can derive that the existence of a pair (x, z) G such that x — zr = \ and 
c G A{x^ z), and 

(c, Y'^K) = (c, y") - zf < a; - = 1. 
We proved that 3^(1) C A{1)° , and we complete the proof by the fact that y{y) = -4(1)°. □ 

Under the assumption that 6t — at is deterministic, the above Lemma gives a nice char- 
acterization of our dual domain that each element Tt{y) in y{y) is actually the product 
of the discounted supermartingale DtYt{y) and the unique discounting stochastic process 

Kt = (l + 5tj^e^ti^--'^-)d,'"ds^, where the optional process Dt takes values in [0, 1] and 

^(y) £ y{y)i here the set y{y) is conventionally defined as the set of supermartingale defla- 
tors with respect to the admissible wealth process as in Kramkov and Schachermayer [20], 
[21]. Furthermore, it enables us to find some examples of the explicit form of the optimal 
dual process. 
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6.3. An Example in the ltd Process Market Model. In this section, we adopt the same 
incomplete market model driven by Ito processes in the framework of Karatzas, Lehoczky, 
Shreve and Xu [16], and we stih assume 6t — is a deterministic function in time t. 

Specifically, we consider the financial market with one risk-less bond 5*^ modeled by 



(6.13) 



dS\ 



■0 



nS^t, 



•^0 



1, 



and there are m stocks whose price process evolve as 

d 



(6.14) 



dSl = Slbldt + Y,Slai^dW^, i = l, 



, m. 



Here W = {Wt)o<t<T is a d-dimensional Brownian motion on a probability space (r2,F, P), 
and we denote F = {J-t)o<t<T the P-augmentation of the filtration generated by W. We 
assume generally d > m, i.e., the number of sources of uncertainty in the model is at least as 
large as the number of stocks available for investment. 

We assume the interest rate rt and the stock drift vector bt are progressively measurable 
with respect to J-t and satisfy \\bt\\dt < oo and Jq \rt\dt < L a.s. for some constant L > 0. 
The volatility matrix at is also progressively measurable with respect to J-t and we assume 
the relative risk process 



(6.15) 



Ot^a^ {ataJr%-rtlm] 



is well defined. Moreover, we assume WOtW^dt < oo, a.s. under P. 

To be consistent with Theorem 6.1 and 6.2 and Lemma 6.2, we assume our financial market 
satisfies the NFLVR condition, i.e., / 0. 

In incomplete Ito processes markets, Detemple and Zapatero [11] and Englezos and Karatzas 
[12] made the suggestion that it is possible to perform the same program brought up by 
Karatzas, Lehoczky, Shreve and Xu [16], which is to complete the market with some ficti- 
tious stocks and invest in a least favorable manner such that the investor does not invest in 
the additional stocks at all. For the utility maximization problem with consumption habit 
formation, their dual optimization problem eventually is written in the following form 



(6.16) 



inf E 



V{yYi' + 5t^ 



Tt 



y>0,v£H{a) I Jo 

where they define the parameterized exponential local martingale Y^" by 

-f 

2 Jo 

Here, the Hilbert space H(a) is defined as 



dt 



(6.17) 



Yr = exp 



{-i: 



+ iy ]dW, 



^ + \Ws\\^]ds]. 



H{a) = G K{a) : E ^ \\ Us f ds < oo }, 



and the appropriate set K{a) for v is generally given by 

rT 



K{a) 



■ J IWtW'^dt < oo, a.s. and ati^t = 0, Vt € [0, T],a.s.|. 



HABIT FORMATION 



45 



See Karatzas, Lehoczky, Shreve and Xu [16] for the detail definition and arguments. 

Contrary to the optimal consumption problem without habit formation, the previous au- 
thors acknowledged that the optimization problem (6.16) is generically more difficult since 
the dual functional becomes non-convex over the parameter process u G H(a), and some new 
techniques in non-convex optimization is evidently needed. 

However, as we discussed in the previous section, the optimal dual solution lies in the 
closure of the linear transform of a family of supermartingales for general incomplete semi- 
martingale financial market. Therefore, if we formulate the dual functional in the form of 
(6.16), then the set of local martingale deflators is generally too small to contain the dual 
optimizer. 

On the other hand, the market completion argument by Karatzas, Lehoczky, Shreve and 
Xu [16] should work in general. According to Lemma 6.2 and our main results Theorem 6.1 
and 6.2, we can instead define the dual problem in the form 



and it is clear we can now apply the convex duality in Kramkov and Schachermayer [20], [21], 
and the optimal solution happens to be the parameterized exponential local martingale if 
we assume all the market coefficients are bounded, see the proof of maximal elements of set 
3^(1) in Example 4.1 by Karatzas and Zitkovic [17]. These results can successfully resolve the 
open problem mentioned by Detemple and Zapatero [11] and Englezos and Karatzas [12]. 

We end up this section with an explicit example and we consider the utility function given 
by U{t,x) = log(x), such that the conjugate utility function is V(t,y) = — log(y) — 1. 

We give the same construction of the financial market as in Delhaen and Schachermayer [8], 
see also example 5.1 in Kramkov and Schachermayer [20]. One the filtered probability space 
(r2,F,P), where the filtration {J-t)t>o is generated by two independent Brownian motions B 
and on (fi,F,P). 

Define the process L by 



(6.18) 




where we define 



(6.19) 




Lt = exp(Sj - - 



t) 



t > 0. 



Define the stopping time r by 



r = inf{t >0:Lt 




Clearly, we have r < oo a.s. Similarly, construct a martingale 



Mt = eMWt - -t). 



The stopping time t is defined as 



i = inf{t > : Mt = 2}. 
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Define the financial market with the time horizon 

T = tAl, 

and define the stock price process 

St = eM-Bt + ^t), 

such that bt = 1 and at = —1 and the Bond price equals constant 1 at any time t for simplicity. 
Theorem 2.1 in Delbaen and Schachermayer [8] showed the process Y defined as 



y; = L 



is a strictly local martingale under P and corresponds to Y-^ for i/ = by the definition of Y-l^ 
in (6.17). And similar to the argument by Proposition 5.1 in Kramkov and Schachermayer 
[20], we can show that Y^*Kt is the unique optimal solution of the dual optimization problem 
(6.18). 

To this end, for each Y G y, the process y*k ~ ^ supermartingale starting at 

YqSq = 1. Jensen's inequality implies that 



E 



T 



L JO 



log {YtKt)dt 



E 



T 



log 



YtKt 
Y*Kt 



dt 



+ E 



T 



log {Y;Kt)dt 





r YtKt 1 




-Jo 


)dt + E 




lY*Kt\ 



log [Y^Kt dt 



< E 



T 



log (Y:Kt)dt 



Also, following exactly the same proof of Proposition 5.1 in Kramkov and Schachermayer [20], 
we can show that {Y^* MtAT)t>o is the density process of an equivalent martingale measure 
and hence A4 ^ f!> and v{l) < oo. This completes the proof of our claim that Yf*Kt is the 
unique optimal solution of the dual optimization problem (6.18). 

Moreover, we can choose some special discounting processes 6t and at such that there does 
not exist an exponential local martingale Y'^ such that 



(6.20) 



Yt*Kt 



Yy + <5tE 



'- Jt 



To this end, we choose bt and at such that the process 



Gt = Y.*Kt - 5t^ 



'i:^vdvY*x,ds 



Tt 



'- Jt 



is a continuous nonnegative semimartingale, this can be easily achieved by taking bt and 
Kt to be continuous semimartingales since the product of two semimartingales is still a 
semimartingale. Furthermore, we choose bt and at such that the finite variation process At 
appeared in the decomposition of Gt = At + Rt is not identically the constant 1 — Rq. 

Then if (6.20) holds for some exponential local martingale y, it is easy to verify by 
Fubini-Tonelli's theorem that 



Yl- 



Gt 
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which contradicts the condition that the finite variation process is not identically 1 — Rq, 
since a continuous local martingale with finite variation is a constant. This eventually pro- 
vides us an counterexample to show the set of parameterized exponential local martingales 
is too small to contain the dual optimizer for the dual problem (6.16), however, it is the 
proper dual space for the modified optimization problem (6.18) and (6.18) is the correct dual 
problem to the associated utility maximization problem with consumption habit formation 
in the Ito processes model. 
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